[ 714.360405] env[69756]: INFO neutron.common.config [-] Logging enabled! [ 714.360736] env[69756]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev45 [ 714.360892] env[69756]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69756) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 714.361213] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 714.361316] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 714.362170] env[69756]: WARNING oslo_policy.policy [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 714.362392] env[69756]: WARNING oslo_policy.policy [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 714.363945] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] VMware NSXv3 Agent initialized successfully. [ 714.364325] env[69756]: DEBUG oslo_concurrency.lockutils [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] Acquiring lock "singleton_lock" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.364467] env[69756]: DEBUG oslo_concurrency.lockutils [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] Acquired lock "singleton_lock" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.364695] env[69756]: DEBUG oslo_concurrency.lockutils [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] Releasing lock "singleton_lock" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.365089] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] Full set of CONF: {{(pid=69756) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 714.365223] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ******************************************************************************** {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 714.365338] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] Configuration options gathered from: {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 714.365604] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 714.365787] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 714.365901] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ================================================================================ {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 714.366126] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] agent_down_time = 75 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.366314] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] allow_automatic_dhcp_failover = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.366421] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] allow_bulk = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.366578] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] api_extensions_path = {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.366729] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] api_paste_config = api-paste.ini {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.366876] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] auth_strategy = keystone {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.366992] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] backdoor_port = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.367121] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] backdoor_socket = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.367273] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] backlog = 4096 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.367420] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] base_mac = fa:16:3e:00:00:00 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.367581] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] bind_host = 0.0.0.0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.367728] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] bind_port = 9696 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.367870] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] client_socket_timeout = 900 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.368030] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] config_dir = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.368183] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.368305] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] config_source = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.368454] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] control_exchange = neutron {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.368602] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] core_plugin = ml2 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.368748] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] debug = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.368895] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] default_availability_zones = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.369127] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.369297] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] dhcp_agent_notification = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.369423] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] dhcp_agents_per_network = 1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.369568] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] dhcp_lease_duration = 86400 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.369721] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] dhcp_load_type = networks {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.369867] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] dns_domain = openstacklocal {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.370019] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.370191] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] enable_default_route_bfd = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.370336] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] enable_default_route_ecmp = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.370456] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] enable_dvr = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.370592] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] enable_new_agents = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.370731] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.370869] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] enable_signals = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.371020] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] enable_traditional_dhcp = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.371161] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] external_dns_driver = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.371302] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] filter_validation = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.371456] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] global_physnet_mtu = 8950 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.371600] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] graceful_shutdown_timeout = 60 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.371788] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] host = cpu-1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.371934] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] host_dvr_for_dhcp = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.372090] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] http_retries = 3 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.372245] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] instance_format = [instance: %(uuid)s] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.372392] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.372537] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ipam_driver = internal {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.372679] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ipv6_pd_enabled = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.372819] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] l3_ha = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.373012] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.373162] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] l3_ha_network_physical_name = {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.373306] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] l3_ha_network_type = {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.373454] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] log_color = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.373597] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] log_config_append = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.373740] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.373879] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] log_dir = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.374026] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] log_file = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.374144] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] log_options = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.374293] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] log_rotate_interval = 1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.374447] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] log_rotate_interval_type = days {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.374596] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] log_rotation_type = none {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.374713] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.374826] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.375036] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.375187] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.375282] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.375430] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] max_dns_nameservers = 5 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.375575] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] max_header_line = 16384 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.375718] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] max_l3_agents_per_router = 3 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.375858] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] max_logfile_count = 30 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.376018] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] max_logfile_size_mb = 200 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.376162] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] max_subnet_host_routes = 20 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.376310] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] my_ip = 10.180.1.21 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.376465] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] my_ipv6 = ::1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.376595] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] network_auto_schedule = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.376733] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] network_link_prefix = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.376877] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.377035] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] notify_nova_on_port_data_changes = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.377188] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] notify_nova_on_port_status_changes = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.377417] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] pagination_max_limit = -1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.377571] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] publish_errors = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.377717] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] rate_limit_burst = 0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.377867] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] rate_limit_except_level = CRITICAL {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.378017] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] rate_limit_interval = 0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.378267] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] retry_until_window = 30 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.378421] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] router_distributed = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.378570] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] rpc_resources_processing_step = 20 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.378715] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] rpc_response_max_timeout = 600 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.378861] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] rpc_response_timeout = 60 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.379025] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] send_events_interval = 2 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.379184] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] service_plugins = ['router'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.379331] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] setproctitle = on {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.379471] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] shell_completion = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.379615] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] state_path = /opt/stack/data/neutron {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.379761] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] syslog_log_facility = LOG_USER {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.379902] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] tcp_keepidle = 600 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.380094] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] transport_url = **** {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.380245] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] use_journal = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.380388] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] use_json = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.380559] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] use_ssl = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.380701] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] use_stderr = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.380865] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] use_syslog = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.381016] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] vlan_qinq = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.381159] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] vlan_transparent = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.381315] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] watch_log_file = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.381461] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] wsgi_default_pool_size = 100 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.381600] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] wsgi_keep_alive = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.381747] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.381889] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] wsgi_server_debug = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 714.382065] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_concurrency.disable_process_locking = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.382222] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.382436] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.382604] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.382757] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.382929] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.383114] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.383280] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.connection_string = messaging:// {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.383432] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.enabled = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.383583] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.es_doc_type = notification {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.383731] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.es_scroll_size = 10000 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.383877] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.es_scroll_time = 2m {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.384030] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.filter_error_trace = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.384209] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.hmac_keys = **** {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.384330] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.sentinel_service_name = mymaster {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.384483] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.socket_timeout = 0.1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.384630] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.trace_requests = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.384770] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler.trace_sqlalchemy = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.384928] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler_jaeger.process_tags = {} {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.385108] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler_jaeger.service_name_prefix = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.385268] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] profiler_otlp.service_name_prefix = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.385428] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.enforce_new_defaults = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.385719] env[69756]: WARNING oslo_config.cfg [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 714.385880] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.enforce_scope = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.386050] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.policy_default_rule = default {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.386219] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.386374] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.386627] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.386679] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.386798] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.386939] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.387154] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.387274] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_policy.remote_timeout = 60.0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.387511] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.387618] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] agent.extensions = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.387803] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.387963] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] service_providers.service_provider = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.388200] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.default_quota = -1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.388366] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.388515] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.quota_floatingip = 50 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.388662] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.quota_network = 100 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.388804] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.quota_port = 500 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.388946] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.389186] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.quota_router = 10 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.389356] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.quota_security_group = 10 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.389507] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.389650] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.quota_subnet = 100 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.389794] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] QUOTAS.track_quota_usage = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.389953] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.390108] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep.group = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.390251] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep.helper_command = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.390400] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.390543] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep.thread_pool_size = 8 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.390683] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep.user = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.390835] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.390976] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_dhcp_release.group = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.391134] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_dhcp_release.helper_command = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.391283] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.391427] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.391566] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_dhcp_release.user = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.391717] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.391909] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_ovs_vsctl.group = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.392088] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_ovs_vsctl.helper_command = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.392281] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.392387] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.392528] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_ovs_vsctl.user = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.392677] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_namespace.capabilities = [21] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.392818] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_namespace.group = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.392981] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_namespace.helper_command = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.393147] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.393294] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_namespace.thread_pool_size = 8 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.393434] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_namespace.user = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.393583] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_conntrack.capabilities = [12] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.393721] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_conntrack.group = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.393862] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_conntrack.helper_command = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.394016] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.394165] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.394306] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_conntrack.user = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.394455] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_link.capabilities = [12, 21] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.394597] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_link.group = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.394736] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_link.helper_command = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.394881] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.395063] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_link.thread_pool_size = 8 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.395216] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] privsep_link.user = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.395382] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.395541] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.395687] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.continue_on_failed_promotions = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.395831] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.dscp = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.395992] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.dscp_inherit = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.396149] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.force_mp_to_policy = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.396294] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.locking_coordinator_url = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.396439] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.log_agent_heartbeats = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.396585] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.logging_expire = 1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.396794] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.396888] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.397053] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.polling_interval = 240 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.397209] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.397367] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.397521] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.report_interval = 30.0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.397673] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.397826] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.397981] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.398152] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.sync_skew = 60 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.398302] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.synchronization_queue_size = 20 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.398452] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT.use_helper_for_ns_read = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.398598] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] SECURITYGROUP.enable_ipset = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.398755] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] SECURITYGROUP.enable_security_group = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.398907] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.399077] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.399236] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] experimental.ipv6_pd_enabled = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.399404] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ml2.extension_drivers = ['port_security'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.399549] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ml2.external_network_type = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.399705] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.399858] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ml2.overlay_ip_version = 4 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.400017] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ml2.path_mtu = 8950 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.400169] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ml2.physical_network_mtus = {} {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.400325] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ml2.tenant_network_types = ['vlan'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.400477] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.400631] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ml2.type_drivers = ['vlan'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.400786] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT_CLI.neutron_port_id = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.400932] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.401095] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.401282] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.401441] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.401591] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.401743] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.401894] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.402056] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.402272] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.402431] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_login_password = **** {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.402582] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_login_port = 443 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.402732] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_login_user = admin {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.402907] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.403096] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.403253] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.403400] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.403555] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.403712] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.403865] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.404022] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.404180] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.404331] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.404483] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.404629] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.404777] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.405012] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.405205] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] vsphere.vsphere_login_password = VMware1! {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.405350] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.405495] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.405646] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.auth_section = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.405798] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.auth_type = password {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.405949] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.406136] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.certfile = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.407155] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.collect_timing = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.407155] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.endpoint_type = public {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.407155] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.insecure = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.407155] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.keyfile = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.407306] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.region_name = RegionOne {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.407516] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.split_loggers = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.407721] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] nova.timeout = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.407893] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.auth_section = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.408136] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.auth_type = password {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.408316] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.408509] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.certfile = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.408737] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.collect_timing = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.408947] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.endpoint_type = public {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.409142] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.insecure = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.409297] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.keyfile = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.409439] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.region_name = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.409584] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.split_loggers = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.409725] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] placement.timeout = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.409875] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.auth_section = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.410030] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.auth_type = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.410178] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.cafile = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.410315] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.certfile = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.410458] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.collect_timing = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.410598] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.connect_retries = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.410736] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.connect_retry_delay = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.410876] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.enable_notifications = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.411029] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.endpoint_override = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.411187] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.insecure = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.411321] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.interface = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.411458] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.keyfile = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.411596] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.max_version = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.411731] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.min_version = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.411866] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.region_name = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.412023] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.retriable_status_codes = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.412164] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.service_name = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.412304] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.service_type = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.412450] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.split_loggers = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.412589] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.status_code_retries = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.412725] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.status_code_retry_delay = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.412873] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.timeout = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.413063] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.valid_interfaces = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.413218] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ironic.version = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.413369] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] cli_script.dry_run = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.413525] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.413668] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.413812] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.413955] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.414112] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.414257] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.414396] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.414537] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.414677] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.414828] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.414978] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.415160] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.415648] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.415648] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.415648] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.415742] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.415887] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.416069] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.416242] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.416417] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.416594] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.416819] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.417056] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.417291] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.417480] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.417680] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.417871] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.418075] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.418274] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.418494] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.418702] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.ssl = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.418920] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.419109] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.419265] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.419418] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.419569] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.ssl_version = {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.419712] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.419868] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_notifications.driver = [] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.420030] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_notifications.retry = -1 {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.420200] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.420343] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] oslo_messaging_notifications.transport_url = **** {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 714.420460] env[69756]: DEBUG oslo_service.backend.eventlet.service [None req-badaf80f-a031-448f-85b8-16db07d6080f None None] ******************************************************************************** {{(pid=69756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 714.421497] env[69756]: DEBUG neutron.agent.securitygroups_rpc [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Init firewall settings (driver=nsxv3) {{(pid=69756) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 714.422815] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69756) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 714.423140] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] RPC agent_id: nsxm-l-01a.corp.local [ 714.425453] env[69756]: DEBUG dogpile.cache.region [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.425579] env[69756]: DEBUG dogpile.lock [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.425683] env[69756]: DEBUG dogpile.lock [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.425780] env[69756]: DEBUG dogpile.lock [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.425881] env[69756]: DEBUG dogpile.cache.region [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.425986] env[69756]: DEBUG dogpile.lock [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.426134] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.489951] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Session token - acquiring [ 714.491887] env[69756]: DEBUG networking_nsxv3.common.locking [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.492115] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.492191] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.492649] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.504463] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.823202] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 714.858972] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.859189] env[69756]: DEBUG dogpile.cache.region [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Cache value generated in 0.433 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 714.859287] env[69756]: DEBUG dogpile.lock [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.859471] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Activating Policy API Provider. [ 714.859682] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Looking for the default Infrastructure Rules. [ 714.931980] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Looking for the Default Layer3 Logged Drop Section. [ 714.949847] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 714.950349] env[69756]: DEBUG networking_nsxv3.common.locking [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.950535] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquiring lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.950645] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.950954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired external semaphore "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.951319] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.466534] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.969230] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.471237] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Inventory metadata is going to be refreshed. [ 716.471650] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 717.302107] env[69756]: DEBUG networking_nsxv3.common.locking [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.302345] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.302396] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.302699] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.313756] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 717.314761] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.315781] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 717.335536] env[69756]: DEBUG networking_nsxv3.common.locking [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.335774] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.335774] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.336086] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.336222] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.336392] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 717.336499] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 717.336612] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 717.356989] env[69756]: DEBUG networking_nsxv3.common.locking [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.357226] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.357279] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.357580] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.357764] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.357917] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 717.377131] env[69756]: DEBUG networking_nsxv3.common.locking [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.377371] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.377422] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.377697] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.377849] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.378012] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 717.396273] env[69756]: DEBUG networking_nsxv3.common.locking [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.396477] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquiring lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.396526] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.396825] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired external semaphore "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.396970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Releasing lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.397180] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 717.397293] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 717.397349] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 717.414169] env[69756]: DEBUG networking_nsxv3.common.locking [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.414375] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquiring lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.414436] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.414717] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired external semaphore "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.414844] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Releasing lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.415038] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 717.415150] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 717.415252] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 717.437086] env[69756]: DEBUG networking_nsxv3.common.locking [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.437319] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.437396] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.437664] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.437804] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.437963] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 717.438083] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 717.438223] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Inventory metadata have been refreshed. [ 717.438335] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Dryrun:True. Metadata refresh completed. [ 717.438462] env[69756]: DEBUG oslo_concurrency.lockutils [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Releasing lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.440408] env[69756]: INFO neutron.agent.agent_extensions_manager [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Loaded agent extensions: [] [ 717.441139] env[69756]: DEBUG neutron_lib.callbacks.manager [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69756) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 717.496496] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent RPC Daemon Started! [ 717.496496] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:0 started [ 717.496496] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent out of sync with plugin! [ 722.441822] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 722.442188] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 727.443096] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 727.443096] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 732.096245] env[69756]: INFO networking_nsxv3.common.synchronization [None req-11f37b12-a4d7-4afa-afb4-8d3bdace2aae demo admin] Enqueued Resource ID: bcef7792-7fb1-4bab-b53c-63b4a4ee991f with Priority: HIGHEST for action security_group_rules [ 732.096245] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcef7792-7fb1-4bab-b53c-63b4a4ee991f with Priority: HIGHEST for action security_group_rules [ 732.096578] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcef7792-7fb1-4bab-b53c-63b4a4ee991f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.096702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcef7792-7fb1-4bab-b53c-63b4a4ee991f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.096770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcef7792-7fb1-4bab-b53c-63b4a4ee991f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.097220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcef7792-7fb1-4bab-b53c-63b4a4ee991f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.097371] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcef7792-7fb1-4bab-b53c-63b4a4ee991f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.616866] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.617226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.617226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.617367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.617367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.617543] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcef7792-7fb1-4bab-b53c-63b4a4ee991f already deleted. [ 732.617624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcef7792-7fb1-4bab-b53c-63b4a4ee991f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.097434] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 737.097805] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 742.098740] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 742.099143] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 747.100095] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 747.100444] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 752.102236] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 752.102645] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 757.103754] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 757.104053] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 762.104751] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 762.105048] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 762.454826] env[69756]: INFO networking_nsxv3.common.synchronization [None req-890986bb-16e0-46fa-bcc6-fa8751605e2c None None] Enqueued Resource ID: d42f84ad-37f1-4f02-9f86-7339f8b3d1e2 with Priority: HIGHEST for action port [ 762.454826] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d42f84ad-37f1-4f02-9f86-7339f8b3d1e2 with Priority: HIGHEST for action port [ 762.454826] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d42f84ad-37f1-4f02-9f86-7339f8b3d1e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.454826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d42f84ad-37f1-4f02-9f86-7339f8b3d1e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.454826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d42f84ad-37f1-4f02-9f86-7339f8b3d1e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.454826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d42f84ad-37f1-4f02-9f86-7339f8b3d1e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.454826] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d42f84ad-37f1-4f02-9f86-7339f8b3d1e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.775107] env[69756]: INFO networking_nsxv3.common.synchronization [None req-fac1e8f9-7356-4392-9961-c70524caf4b3 None None] Enqueued Resource ID: b01a79fc-d436-4a64-acd7-4685f5b99e42 with Priority: HIGHEST for action port [ 762.775107] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b01a79fc-d436-4a64-acd7-4685f5b99e42 with Priority: HIGHEST for action port [ 762.775622] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b01a79fc-d436-4a64-acd7-4685f5b99e42 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.775749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b01a79fc-d436-4a64-acd7-4685f5b99e42" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.775817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b01a79fc-d436-4a64-acd7-4685f5b99e42" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.776526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b01a79fc-d436-4a64-acd7-4685f5b99e42" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.776766] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b01a79fc-d436-4a64-acd7-4685f5b99e42',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.960652] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d42f84ad-37f1-4f02-9f86-7339f8b3d1e2 [ 762.960652] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.960652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.960652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.960652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.960652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.960652] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d42f84ad-37f1-4f02-9f86-7339f8b3d1e2 already deleted. [ 762.960652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d42f84ad-37f1-4f02-9f86-7339f8b3d1e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.282583] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b01a79fc-d436-4a64-acd7-4685f5b99e42 [ 763.283442] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.283442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.283442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.283442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.283442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.283442] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b01a79fc-d436-4a64-acd7-4685f5b99e42 already deleted. [ 763.283442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b01a79fc-d436-4a64-acd7-4685f5b99e42" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.333163] env[69756]: INFO networking_nsxv3.common.synchronization [None req-c3156dde-1a81-49a1-9d1b-ae0b56d9d514 None None] Enqueued Resource ID: 31bc9818-a1f5-4712-8692-48c14b021e58 with Priority: HIGHEST for action port [ 763.333411] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31bc9818-a1f5-4712-8692-48c14b021e58 with Priority: HIGHEST for action port [ 763.333955] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-31bc9818-a1f5-4712-8692-48c14b021e58 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.334083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31bc9818-a1f5-4712-8692-48c14b021e58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.334232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31bc9818-a1f5-4712-8692-48c14b021e58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.334394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31bc9818-a1f5-4712-8692-48c14b021e58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.334478] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31bc9818-a1f5-4712-8692-48c14b021e58',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.838638] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31bc9818-a1f5-4712-8692-48c14b021e58 [ 763.838793] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.839052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.839052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.839282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.839378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.839470] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31bc9818-a1f5-4712-8692-48c14b021e58 already deleted. [ 763.839556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31bc9818-a1f5-4712-8692-48c14b021e58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.700189] env[69756]: INFO networking_nsxv3.common.synchronization [None req-88dffb9b-d662-4c1c-89bf-47f781226bff None None] Enqueued Resource ID: e4cc4669-836d-4771-b7fe-970d077adc85 with Priority: HIGHEST for action port [ 765.700189] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4cc4669-836d-4771-b7fe-970d077adc85 with Priority: HIGHEST for action port [ 765.700189] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4cc4669-836d-4771-b7fe-970d077adc85 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.700189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4cc4669-836d-4771-b7fe-970d077adc85" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.700189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4cc4669-836d-4771-b7fe-970d077adc85" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.700189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4cc4669-836d-4771-b7fe-970d077adc85" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.700189] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4cc4669-836d-4771-b7fe-970d077adc85',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.745567] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b680c0b6-3cc1-43e5-8797-037c4346143a None None] Enqueued Resource ID: f7959d6a-416a-40b7-adf8-96ce07e8724a with Priority: HIGHEST for action port [ 765.745567] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7959d6a-416a-40b7-adf8-96ce07e8724a with Priority: HIGHEST for action port [ 765.745567] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7959d6a-416a-40b7-adf8-96ce07e8724a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.745567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7959d6a-416a-40b7-adf8-96ce07e8724a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.745567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7959d6a-416a-40b7-adf8-96ce07e8724a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.746254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7959d6a-416a-40b7-adf8-96ce07e8724a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.746254] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7959d6a-416a-40b7-adf8-96ce07e8724a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.797865] env[69756]: INFO networking_nsxv3.common.synchronization [None req-bdb692e1-500e-4825-9284-9a2ada9e3fc3 None None] Enqueued Resource ID: c82d7779-c2cc-4b54-a064-99c736bd956c with Priority: HIGHEST for action port [ 765.798913] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c82d7779-c2cc-4b54-a064-99c736bd956c with Priority: HIGHEST for action port [ 765.799245] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c82d7779-c2cc-4b54-a064-99c736bd956c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.799366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c82d7779-c2cc-4b54-a064-99c736bd956c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.799574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c82d7779-c2cc-4b54-a064-99c736bd956c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.799669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c82d7779-c2cc-4b54-a064-99c736bd956c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.799750] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c82d7779-c2cc-4b54-a064-99c736bd956c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.205097] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4cc4669-836d-4771-b7fe-970d077adc85 [ 766.205097] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.205097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.205097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.205097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.205097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.205097] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4cc4669-836d-4771-b7fe-970d077adc85 already deleted. [ 766.205097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4cc4669-836d-4771-b7fe-970d077adc85" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.252544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7959d6a-416a-40b7-adf8-96ce07e8724a [ 766.252806] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.252966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.253061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.253486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.253486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.253486] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7959d6a-416a-40b7-adf8-96ce07e8724a already deleted. [ 766.253591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7959d6a-416a-40b7-adf8-96ce07e8724a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.303197] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c82d7779-c2cc-4b54-a064-99c736bd956c [ 766.303420] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.303548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.303615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.310217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.310362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.310485] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c82d7779-c2cc-4b54-a064-99c736bd956c already deleted. [ 766.310576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c82d7779-c2cc-4b54-a064-99c736bd956c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.332800] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8b48ef18-ac44-49ab-9728-2710f5d36c10 None None] Enqueued Resource ID: 8fc1b3b1-4fa3-4293-97f5-5a9063035855 with Priority: HIGHEST for action port [ 766.333051] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc1b3b1-4fa3-4293-97f5-5a9063035855 with Priority: HIGHEST for action port [ 766.333609] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fc1b3b1-4fa3-4293-97f5-5a9063035855 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.333726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fc1b3b1-4fa3-4293-97f5-5a9063035855" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.333793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fc1b3b1-4fa3-4293-97f5-5a9063035855" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.334035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fc1b3b1-4fa3-4293-97f5-5a9063035855" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.334112] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fc1b3b1-4fa3-4293-97f5-5a9063035855',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.471283] env[69756]: INFO networking_nsxv3.common.synchronization [None req-ba220af7-f99b-4c73-90ac-2956e1f8ccdd None None] Enqueued Resource ID: 1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c with Priority: HIGHEST for action port [ 766.471530] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c with Priority: HIGHEST for action port [ 766.472084] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.473113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.473113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.473113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.473113] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.835602] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fc1b3b1-4fa3-4293-97f5-5a9063035855 [ 766.835933] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.836037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.836111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.836496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.836496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.836625] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fc1b3b1-4fa3-4293-97f5-5a9063035855 already deleted. [ 766.836674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fc1b3b1-4fa3-4293-97f5-5a9063035855" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.975906] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c [ 766.976566] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.976758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.976874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.977095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.977185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.977294] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c already deleted. [ 766.977379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f6b6aef-3cbf-4e16-a2c1-9ca042f3902c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.989223] env[69756]: INFO networking_nsxv3.common.synchronization [None req-831e5b13-ed2b-4118-855f-e91bc6a98703 None None] Enqueued Resource ID: b35f81ee-515b-41e2-bb4f-7e4c50e084ac with Priority: HIGHEST for action port [ 766.989425] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b35f81ee-515b-41e2-bb4f-7e4c50e084ac with Priority: HIGHEST for action port [ 766.990010] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b35f81ee-515b-41e2-bb4f-7e4c50e084ac taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.990202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b35f81ee-515b-41e2-bb4f-7e4c50e084ac" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.990278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b35f81ee-515b-41e2-bb4f-7e4c50e084ac" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.990530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b35f81ee-515b-41e2-bb4f-7e4c50e084ac" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.990618] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b35f81ee-515b-41e2-bb4f-7e4c50e084ac',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.190740] env[69756]: INFO networking_nsxv3.common.synchronization [None req-ad163e12-9aa7-4bb8-abbc-d78bf4fbbe96 None None] Enqueued Resource ID: be5b61bd-2bc0-4340-95ec-f8dd7e1710be with Priority: HIGHEST for action port [ 767.191289] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be5b61bd-2bc0-4340-95ec-f8dd7e1710be with Priority: HIGHEST for action port [ 767.191678] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-be5b61bd-2bc0-4340-95ec-f8dd7e1710be taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.193084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be5b61bd-2bc0-4340-95ec-f8dd7e1710be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.193200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be5b61bd-2bc0-4340-95ec-f8dd7e1710be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.193537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be5b61bd-2bc0-4340-95ec-f8dd7e1710be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.193699] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be5b61bd-2bc0-4340-95ec-f8dd7e1710be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.493371] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b35f81ee-515b-41e2-bb4f-7e4c50e084ac [ 767.494839] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.494839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.494839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.494839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.494839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.494839] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b35f81ee-515b-41e2-bb4f-7e4c50e084ac already deleted. [ 767.494839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b35f81ee-515b-41e2-bb4f-7e4c50e084ac" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.696998] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be5b61bd-2bc0-4340-95ec-f8dd7e1710be [ 767.697978] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.697978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.697978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.697978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.697978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.697978] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be5b61bd-2bc0-4340-95ec-f8dd7e1710be already deleted. [ 767.697978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be5b61bd-2bc0-4340-95ec-f8dd7e1710be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.737748] env[69756]: INFO networking_nsxv3.common.synchronization [None req-5515cff8-8289-40e3-a6e9-55a3905bc3c1 None None] Enqueued Resource ID: ec841bca-aec9-494f-a5c2-ab6fca92b093 with Priority: HIGHEST for action port [ 769.740097] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec841bca-aec9-494f-a5c2-ab6fca92b093 with Priority: HIGHEST for action port [ 769.742540] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec841bca-aec9-494f-a5c2-ab6fca92b093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.742678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec841bca-aec9-494f-a5c2-ab6fca92b093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.742753] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec841bca-aec9-494f-a5c2-ab6fca92b093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.743011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec841bca-aec9-494f-a5c2-ab6fca92b093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.743105] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec841bca-aec9-494f-a5c2-ab6fca92b093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.004889] env[69756]: INFO networking_nsxv3.common.synchronization [None req-6b0ec880-1964-4c3f-bb1c-87f5ba9cbcbb tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 770.004889] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 770.005242] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.005242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.005375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.005620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.005700] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.247862] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec841bca-aec9-494f-a5c2-ab6fca92b093 [ 770.248245] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.249324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.250102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.250388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.250592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.251185] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec841bca-aec9-494f-a5c2-ab6fca92b093 already deleted. [ 770.253161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec841bca-aec9-494f-a5c2-ab6fca92b093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.343203] env[69756]: INFO networking_nsxv3.common.synchronization [None req-6ece32d8-772b-4d33-84d3-452855542129 tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 770.343768] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 770.344078] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.344181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.528133] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.528133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.528133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.528133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.528133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.528133] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 already deleted. [ 770.528133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.528410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.528955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.528955] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.056277] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.056927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.056927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.056927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.056927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.056927] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 already deleted. [ 771.056927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.424195] env[69756]: INFO networking_nsxv3.common.synchronization [None req-762408d9-e7d5-4f2c-9158-1203cc5c9179 None None] Enqueued Resource ID: 5e811f94-aea9-4f81-b614-5c2604ecd544 with Priority: HIGHEST for action port [ 771.424195] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e811f94-aea9-4f81-b614-5c2604ecd544 with Priority: HIGHEST for action port [ 771.424195] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e811f94-aea9-4f81-b614-5c2604ecd544 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.424195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e811f94-aea9-4f81-b614-5c2604ecd544" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.424195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e811f94-aea9-4f81-b614-5c2604ecd544" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.424195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e811f94-aea9-4f81-b614-5c2604ecd544" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.424793] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e811f94-aea9-4f81-b614-5c2604ecd544',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.445540] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.445540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.445540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.445540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.445540] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.487542] env[69756]: INFO networking_nsxv3.common.synchronization [None req-0625563f-8eac-4135-9eec-cefd6fc49d81 None None] Enqueued Resource ID: 3e43a60a-d1fa-45ec-b92b-c7bb44476e5b with Priority: HIGHEST for action port [ 771.487798] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e43a60a-d1fa-45ec-b92b-c7bb44476e5b with Priority: HIGHEST for action port [ 771.488519] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e43a60a-d1fa-45ec-b92b-c7bb44476e5b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.488519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e43a60a-d1fa-45ec-b92b-c7bb44476e5b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.488628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e43a60a-d1fa-45ec-b92b-c7bb44476e5b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.488803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e43a60a-d1fa-45ec-b92b-c7bb44476e5b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.489284] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e43a60a-d1fa-45ec-b92b-c7bb44476e5b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.928677] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e811f94-aea9-4f81-b614-5c2604ecd544 [ 771.928912] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.929980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.929980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.930403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.931052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.931052] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e811f94-aea9-4f81-b614-5c2604ecd544 already deleted. [ 771.931052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e811f94-aea9-4f81-b614-5c2604ecd544" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.952442] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.997125] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e43a60a-d1fa-45ec-b92b-c7bb44476e5b [ 771.997748] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.997748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.997748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.000084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.000084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.000084] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e43a60a-d1fa-45ec-b92b-c7bb44476e5b already deleted. [ 772.000084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e43a60a-d1fa-45ec-b92b-c7bb44476e5b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.051223] env[69756]: INFO networking_nsxv3.common.synchronization [None req-3c6bf4dd-7695-41a8-878b-1af96d9ed639 None None] Enqueued Resource ID: 4afba40b-762e-41ce-af64-f0705db5d351 with Priority: HIGHEST for action port [ 772.051573] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4afba40b-762e-41ce-af64-f0705db5d351 with Priority: HIGHEST for action port [ 772.052079] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-4afba40b-762e-41ce-af64-f0705db5d351 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.052201] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4afba40b-762e-41ce-af64-f0705db5d351" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.052983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4afba40b-762e-41ce-af64-f0705db5d351" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.052983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4afba40b-762e-41ce-af64-f0705db5d351" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.052983] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4afba40b-762e-41ce-af64-f0705db5d351',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.445750] env[69756]: INFO networking_nsxv3.common.synchronization [req-6fb55202-0d6b-4523-b68c-59182d15fe92 req-dfdd6c49-9c91-4dfc-bc82-4c66b07fe349 tempest-DeleteServersAdminTestJSON-1550782210 tempest-DeleteServersAdminTestJSON-1550782210-project-member] Enqueued Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 772.446311] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 772.446622] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.446736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.446801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.448715] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.448930] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.449064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.449129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.449309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.449392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.449488] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.457624] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.557682] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4afba40b-762e-41ce-af64-f0705db5d351 [ 772.557682] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.557682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.557682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.557682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.557682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.557682] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4afba40b-762e-41ce-af64-f0705db5d351 already deleted. [ 772.557682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4afba40b-762e-41ce-af64-f0705db5d351" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.778967] env[69756]: INFO networking_nsxv3.common.synchronization [None req-3964f339-3dda-44bc-8133-fdaacc719ff5 None None] Enqueued Resource ID: ecad8084-6a4f-4347-b2d8-7ac6cd52a35c with Priority: HIGHEST for action port [ 772.779237] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecad8084-6a4f-4347-b2d8-7ac6cd52a35c with Priority: HIGHEST for action port [ 772.781074] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecad8084-6a4f-4347-b2d8-7ac6cd52a35c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.781074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecad8084-6a4f-4347-b2d8-7ac6cd52a35c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.781074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecad8084-6a4f-4347-b2d8-7ac6cd52a35c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.781074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecad8084-6a4f-4347-b2d8-7ac6cd52a35c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.781074] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecad8084-6a4f-4347-b2d8-7ac6cd52a35c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.897331] env[69756]: INFO networking_nsxv3.common.synchronization [None req-70d60404-7b2a-49e7-a11c-368b1fc88952 None None] Enqueued Resource ID: 118a7811-6f39-418c-87bb-a8252cdb1a1e with Priority: HIGHEST for action port [ 772.897331] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118a7811-6f39-418c-87bb-a8252cdb1a1e with Priority: HIGHEST for action port [ 772.897681] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-118a7811-6f39-418c-87bb-a8252cdb1a1e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.897955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-118a7811-6f39-418c-87bb-a8252cdb1a1e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.897955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-118a7811-6f39-418c-87bb-a8252cdb1a1e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.898128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-118a7811-6f39-418c-87bb-a8252cdb1a1e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.898408] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('118a7811-6f39-418c-87bb-a8252cdb1a1e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.955765] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.955765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.955765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.955765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.955765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.955765] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.955765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.955765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.955765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.955765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.955765] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bf1989-7e31-4042-8158-612d65438abc already deleted. [ 772.955765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.962046] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 772.962046] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 772.985934] env[69756]: INFO networking_nsxv3.common.synchronization [None req-394fe4e5-cce4-43ee-9688-4eb2db215171 None None] Enqueued Resource ID: 2065d14c-ce2e-4266-b67a-d8228ed512db with Priority: HIGHEST for action port [ 772.986584] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2065d14c-ce2e-4266-b67a-d8228ed512db with Priority: HIGHEST for action port [ 772.986800] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-2065d14c-ce2e-4266-b67a-d8228ed512db taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.987043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2065d14c-ce2e-4266-b67a-d8228ed512db" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.987043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2065d14c-ce2e-4266-b67a-d8228ed512db" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.988138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2065d14c-ce2e-4266-b67a-d8228ed512db" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.988235] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2065d14c-ce2e-4266-b67a-d8228ed512db',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.282577] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecad8084-6a4f-4347-b2d8-7ac6cd52a35c [ 773.282820] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.283533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.283533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.283533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.283533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.283533] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecad8084-6a4f-4347-b2d8-7ac6cd52a35c already deleted. [ 773.283533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecad8084-6a4f-4347-b2d8-7ac6cd52a35c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.401978] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 118a7811-6f39-418c-87bb-a8252cdb1a1e [ 773.401978] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.401978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.401978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.402543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.402617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.402730] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:118a7811-6f39-418c-87bb-a8252cdb1a1e already deleted. [ 773.402872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-118a7811-6f39-418c-87bb-a8252cdb1a1e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.491016] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2065d14c-ce2e-4266-b67a-d8228ed512db [ 773.491016] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.491016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.491016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.491016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.491016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.491016] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2065d14c-ce2e-4266-b67a-d8228ed512db already deleted. [ 773.491016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2065d14c-ce2e-4266-b67a-d8228ed512db" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.711252] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.714042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.714042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.714249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.733839] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 773.738106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.739150] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 773.758776] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.759474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.759579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.759959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.760079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.760278] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 773.760278] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 773.760460] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 773.783303] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.783527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.783527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.783800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.784284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.784526] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 773.809743] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.809886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.810094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.810192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.810292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.810406] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 773.839568] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.839568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.839568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.839568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.839568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.839568] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 773.839568] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 773.839568] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 773.863306] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.863306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.863306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.863306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.863306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.863306] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 773.863306] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 773.863306] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 773.883716] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.883883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.883955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.884154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.884251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.884368] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 773.884519] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 773.884519] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 773.884611] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 773.884656] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 773.885035] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 773.885035] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 773.885175] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 773.885175] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 773.885262] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 773.910541] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.910703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.915673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.915900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.916117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.916255] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 773.940028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.940028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.940028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.940208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.940253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.957342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.108268] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.108678] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.108927] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.109324] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.109715] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.110093] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.110334] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.110912] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.111191] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.111580] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.111832] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.112063] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.112279] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.112813] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.115063] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.115063] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.134736] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.135027] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 774.135383] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.135625] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.136121] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.136419] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.136631] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.138393] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.138474] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.380202] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b79a4477-980b-4d65-a96d-24ae5fc6e527 None None] Enqueued Resource ID: eae15a78-c4ec-4141-a59a-c052f20a6792 with Priority: HIGHEST for action port [ 774.380479] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eae15a78-c4ec-4141-a59a-c052f20a6792 with Priority: HIGHEST for action port [ 774.381034] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-eae15a78-c4ec-4141-a59a-c052f20a6792 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.381196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eae15a78-c4ec-4141-a59a-c052f20a6792" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.381252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eae15a78-c4ec-4141-a59a-c052f20a6792" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.381481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eae15a78-c4ec-4141-a59a-c052f20a6792" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.381573] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eae15a78-c4ec-4141-a59a-c052f20a6792',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.643640] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.643640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.643640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.643640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.643640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.643640] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d not found, creating... [ 774.643640] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.643640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.643640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.643640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.643640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.645715] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.646167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.646523] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.652416] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.652416] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.652416] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d is going to be created. [ 774.676060] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.676060] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.676060] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.676060] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.676060] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.676060] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.886156] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eae15a78-c4ec-4141-a59a-c052f20a6792 [ 774.886156] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.886156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.886156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.886156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.886156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.886156] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eae15a78-c4ec-4141-a59a-c052f20a6792 already deleted. [ 774.886156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eae15a78-c4ec-4141-a59a-c052f20a6792" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.879345] env[69756]: INFO networking_nsxv3.common.synchronization [req-6fb55202-0d6b-4523-b68c-59182d15fe92 req-e0895cfc-b3b4-4bee-9903-8fe3c56f0389 service nova] Enqueued Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_rules [ 775.879345] env[69756]: INFO networking_nsxv3.common.synchronization [req-6fb55202-0d6b-4523-b68c-59182d15fe92 req-e0895cfc-b3b4-4bee-9903-8fe3c56f0389 service nova] Enqueued Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 775.879345] env[69756]: INFO networking_nsxv3.common.synchronization [req-6fb55202-0d6b-4523-b68c-59182d15fe92 req-e0895cfc-b3b4-4bee-9903-8fe3c56f0389 service nova] Enqueued Resource ID: 7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d with Priority: HIGHEST for action port [ 775.879345] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_rules [ 775.879345] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 775.879345] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d with Priority: HIGHEST for action port [ 775.879345] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.879345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.882847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.886360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.886360] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.886360] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.886360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.886360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.886360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.886360] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.886360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.886360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.886360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.886360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.886360] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.891024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.891024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.891024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.891400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.891761] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.383274] env[69756]: INFO networking_nsxv3.common.synchronization [None req-ed5d4263-1be8-42c8-95fd-4b293db1a3e5 None None] Enqueued Resource ID: 8564e370-95bf-4dbb-8123-5f451263c423 with Priority: HIGHEST for action port [ 776.383750] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8564e370-95bf-4dbb-8123-5f451263c423 with Priority: HIGHEST for action port [ 776.384059] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-8564e370-95bf-4dbb-8123-5f451263c423 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.384180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8564e370-95bf-4dbb-8123-5f451263c423" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.384247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8564e370-95bf-4dbb-8123-5f451263c423" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.384545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8564e370-95bf-4dbb-8123-5f451263c423" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.384619] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8564e370-95bf-4dbb-8123-5f451263c423',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.395845] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.395964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.407754] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.408682] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d with status ACTIVE [ 776.408875] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.408998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.409082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.409279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.409367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.409548] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.409625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.409685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.409832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.409908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.410091] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.410181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.410240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.410389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.410460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.410541] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d is going to be updated. [ 776.432851] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.433209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.433209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.433290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.433395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.433548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b8450e9-a12a-4bd1-ad44-af6ed2a2ed9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.869880] env[69756]: INFO networking_nsxv3.common.synchronization [None req-fb948d6f-2c9c-4ec1-aee6-8b62b7bb178d None None] Enqueued Resource ID: 8c1b84df-02ca-4145-89d4-00349873487f with Priority: HIGHEST for action port [ 776.870488] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c1b84df-02ca-4145-89d4-00349873487f with Priority: HIGHEST for action port [ 776.871298] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c1b84df-02ca-4145-89d4-00349873487f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.871298] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c1b84df-02ca-4145-89d4-00349873487f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.871298] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c1b84df-02ca-4145-89d4-00349873487f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.871828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c1b84df-02ca-4145-89d4-00349873487f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.871828] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c1b84df-02ca-4145-89d4-00349873487f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.888740] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8564e370-95bf-4dbb-8123-5f451263c423 [ 776.889175] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.889175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.889447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.889447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.889553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.889652] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8564e370-95bf-4dbb-8123-5f451263c423 already deleted. [ 776.889760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8564e370-95bf-4dbb-8123-5f451263c423" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.915064] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.374469] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c1b84df-02ca-4145-89d4-00349873487f [ 777.374789] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.375178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.375178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.378010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.378010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.378010] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c1b84df-02ca-4145-89d4-00349873487f already deleted. [ 777.378010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c1b84df-02ca-4145-89d4-00349873487f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.399139] env[69756]: INFO networking_nsxv3.common.synchronization [req-4b6301c1-969b-49ad-a9d1-d7598ea99d69 req-d7f74b12-9514-423a-b651-6996e7a130b6 tempest-SecurityGroupRulesNegativeTestJSON-1801834555 tempest-SecurityGroupRulesNegativeTestJSON-1801834555-project-member] Enqueued Resource ID: b0709409-4adb-4e93-b0c4-fe3173048acc with Priority: HIGHEST for action security_group_rules [ 777.399731] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0709409-4adb-4e93-b0c4-fe3173048acc with Priority: HIGHEST for action security_group_rules [ 777.399981] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0709409-4adb-4e93-b0c4-fe3173048acc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.400127] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0709409-4adb-4e93-b0c4-fe3173048acc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.400198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0709409-4adb-4e93-b0c4-fe3173048acc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.400915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0709409-4adb-4e93-b0c4-fe3173048acc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.400915] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0709409-4adb-4e93-b0c4-fe3173048acc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.416784] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.416946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.417054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.417293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.417388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.417494] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bf1989-7e31-4042-8158-612d65438abc is going to be created. [ 777.453854] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.453854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.453854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.453854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.453854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.470469] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: UNINITIALIZED for 2s [ 777.944341] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.944706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.944706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.945122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.945122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.945979] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0709409-4adb-4e93-b0c4-fe3173048acc already deleted. [ 777.946289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0709409-4adb-4e93-b0c4-fe3173048acc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.833752] env[69756]: INFO networking_nsxv3.common.synchronization [req-f577e609-3237-479b-a6cb-b1b129c2c68a req-09f5f9cf-5f84-4e50-8b17-232e343585d9 tempest-AttachInterfacesV270Test-1182665717 tempest-AttachInterfacesV270Test-1182665717-project-member] Enqueued Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGHEST for action security_group_members [ 778.834327] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGHEST for action security_group_members [ 778.834631] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466bf0f-8177-4a39-85ea-b07bc9efb94c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.834775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.834835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.835280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.835411] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.835515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.835597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.836771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.836871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.836972] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466bf0f-8177-4a39-85ea-b07bc9efb94c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.342949] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.343265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.343265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.344674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.344674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.344674] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.344674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.344674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.344674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.344674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.344674] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c already deleted. [ 779.344674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.483853] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: SUCCESS [ 779.483853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.483853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.483853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.483853] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.483853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.483853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.483853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.483853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.483853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.483853] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.832749] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-278 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.833268] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-278" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.833268] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-278" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.834165] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-278" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.834165] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.835249] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.835452] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.836241] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.836241] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.836436] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.836531] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.836706] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.837338] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.837338] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.837338] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.837338] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.862997] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.862997] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.862997] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.862997] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-278" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.862997] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.862997] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.862997] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.862997] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.862997] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.986199] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.986690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.986788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.987245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.987281] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.987377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.987735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.987735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.987735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.987939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.988981] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.988981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.988981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.988981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.988981] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.988981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.988981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.988981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.988981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.988981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.989278] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.351721] env[69756]: INFO networking_nsxv3.common.synchronization [req-db69870a-0e95-442e-99f8-0defb4cf7a88 req-3f78df5f-f1b9-4e41-af27-5a0156d99ae2 tempest-SecurityGroupRulesNegativeTestJSON-1801834555 tempest-SecurityGroupRulesNegativeTestJSON-1801834555-project-member] Enqueued Resource ID: b0709409-4adb-4e93-b0c4-fe3173048acc with Priority: HIGHEST for action security_group_rules [ 780.354329] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0709409-4adb-4e93-b0c4-fe3173048acc with Priority: HIGHEST for action security_group_rules [ 780.354329] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0709409-4adb-4e93-b0c4-fe3173048acc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.354329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0709409-4adb-4e93-b0c4-fe3173048acc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.354329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0709409-4adb-4e93-b0c4-fe3173048acc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.354329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0709409-4adb-4e93-b0c4-fe3173048acc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.354329] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0709409-4adb-4e93-b0c4-fe3173048acc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.371520] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.371785] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.371999] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.372471] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.372610] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.372832] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b not found, creating... [ 780.373664] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.373664] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.373664] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.373919] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.374330] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.377413] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.377413] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.377413] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.377413] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.377413] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.377413] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b is going to be created. [ 780.405245] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.405245] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.405245] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.405245] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.405245] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.405245] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.491575] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3bf1989-7e31-4042-8158-612d65438abc: rpc.has_security_group_logging(os_id): False [ 780.531077] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.531299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.531396] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.531712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.531837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.532127] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.532275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.532369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.532622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.532746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.533463] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.533649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.533747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.533970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.534115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.534415] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.534556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.534651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.534874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.534991] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.535172] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3bf1989-7e31-4042-8158-612d65438abc is going to be created. [ 780.633349] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.633349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.633349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.633349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.633349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.645193] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: IN_PROGRESS for 2s [ 780.880486] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.880648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.880725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.880960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.881104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.881275] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0709409-4adb-4e93-b0c4-fe3173048acc already deleted. [ 780.881308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0709409-4adb-4e93-b0c4-fe3173048acc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.558117] env[69756]: INFO networking_nsxv3.common.synchronization [None req-c48c2490-85cf-4a6d-ad9c-c8c27332eb90 tempest-VolumesAssistedSnapshotsTest-1545684772 tempest-VolumesAssistedSnapshotsTest-1545684772-project-member] Enqueued Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_rules [ 781.558117] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_rules [ 781.558849] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.558849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.558849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.559111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.559111] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.069149] env[69756]: INFO networking_nsxv3.common.synchronization [None req-cdd0c85c-9c61-4575-9aa8-63ee34ab2bb3 tempest-VolumesAssistedSnapshotsTest-1545684772 tempest-VolumesAssistedSnapshotsTest-1545684772-project-member] Enqueued Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_rules [ 782.069822] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_rules [ 782.070579] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.070579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.089882] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.090038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.090120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.090361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.090457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.090553] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e already deleted. [ 782.090664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.090782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.090986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.091096] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.278216] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e8739dd9-cc0e-48de-bb01-720dc06d3d93 None None] Enqueued Resource ID: 3ecafcc3-49a8-467c-a41b-ac0afcdea91c with Priority: HIGHEST for action port [ 782.278428] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ecafcc3-49a8-467c-a41b-ac0afcdea91c with Priority: HIGHEST for action port [ 782.278991] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ecafcc3-49a8-467c-a41b-ac0afcdea91c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.279258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ecafcc3-49a8-467c-a41b-ac0afcdea91c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.279355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ecafcc3-49a8-467c-a41b-ac0afcdea91c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.279642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ecafcc3-49a8-467c-a41b-ac0afcdea91c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.279756] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ecafcc3-49a8-467c-a41b-ac0afcdea91c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.285123] env[69756]: INFO networking_nsxv3.common.synchronization [req-f577e609-3237-479b-a6cb-b1b129c2c68a req-817b69a3-c1e2-4cfc-8c43-2fd221e9cf69 service nova] Enqueued Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGHEST for action security_group_rules [ 782.285318] env[69756]: INFO networking_nsxv3.common.synchronization [req-f577e609-3237-479b-a6cb-b1b129c2c68a req-817b69a3-c1e2-4cfc-8c43-2fd221e9cf69 service nova] Enqueued Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGHEST for action security_group_members [ 782.285468] env[69756]: INFO networking_nsxv3.common.synchronization [req-f577e609-3237-479b-a6cb-b1b129c2c68a req-817b69a3-c1e2-4cfc-8c43-2fd221e9cf69 service nova] Enqueued Resource ID: dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b with Priority: HIGHEST for action port [ 782.285751] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGHEST for action security_group_rules [ 782.285850] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGHEST for action security_group_members [ 782.285926] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b with Priority: HIGHEST for action port [ 782.286430] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.286593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.286682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.286987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.286987] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1466bf0f-8177-4a39-85ea-b07bc9efb94c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.288033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466bf0f-8177-4a39-85ea-b07bc9efb94c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.288128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.288216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.288411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.288590] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.288946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.289075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.289265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.289382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.289549] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466bf0f-8177-4a39-85ea-b07bc9efb94c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.290512] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.290682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.290732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.290961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.291083] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.494046] env[69756]: INFO networking_nsxv3.common.synchronization [None req-d69f65c9-ef9a-47c2-ac40-d900674e88d9 None None] Enqueued Resource ID: 88fedcb1-cb47-4dfc-b384-893aa7739471 with Priority: HIGHEST for action port [ 782.494046] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88fedcb1-cb47-4dfc-b384-893aa7739471 with Priority: HIGHEST for action port [ 782.494046] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-88fedcb1-cb47-4dfc-b384-893aa7739471 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.494046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88fedcb1-cb47-4dfc-b384-893aa7739471" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.494046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88fedcb1-cb47-4dfc-b384-893aa7739471" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.494046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88fedcb1-cb47-4dfc-b384-893aa7739471" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.494046] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88fedcb1-cb47-4dfc-b384-893aa7739471',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.619068] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.619350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.619350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.620407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.620407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.620407] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e already deleted. [ 782.620407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.659982] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: SUCCESS [ 782.660100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.759948] env[69756]: INFO networking_nsxv3.common.synchronization [None req-ff2bd7c2-3636-4a32-a6a0-30c517c0ee61 None None] Enqueued Resource ID: 84e7e1af-e5aa-4df0-9b05-cd47bc12343f with Priority: HIGHEST for action port [ 782.760261] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84e7e1af-e5aa-4df0-9b05-cd47bc12343f with Priority: HIGHEST for action port [ 782.761183] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-84e7e1af-e5aa-4df0-9b05-cd47bc12343f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.761741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84e7e1af-e5aa-4df0-9b05-cd47bc12343f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.761741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84e7e1af-e5aa-4df0-9b05-cd47bc12343f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.762022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84e7e1af-e5aa-4df0-9b05-cd47bc12343f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.762626] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84e7e1af-e5aa-4df0-9b05-cd47bc12343f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.781921] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ecafcc3-49a8-467c-a41b-ac0afcdea91c [ 782.782108] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.785436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.785436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.785436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.785436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.785436] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ecafcc3-49a8-467c-a41b-ac0afcdea91c already deleted. [ 782.785436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ecafcc3-49a8-467c-a41b-ac0afcdea91c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.792905] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1466bf0f-8177-4a39-85ea-b07bc9efb94c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.794216] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466bf0f-8177-4a39-85ea-b07bc9efb94c taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.794216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.797675] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b with status ACTIVE [ 782.797780] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.797862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.798334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.798580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.798678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.798863] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.799147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.799147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.799243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.799274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.799450] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.799542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.799601] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.799790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.799837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.799893] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b is going to be updated. [ 782.829880] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.829880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.829880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.830798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.831071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.831286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd0bd6c7-b039-4d49-8fad-bacc69ef5f3b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.843706] env[69756]: INFO networking_nsxv3.common.synchronization [None req-d58d8c18-d428-4eca-9ad3-dd53b67d3458 None None] Enqueued Resource ID: 6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d with Priority: HIGHEST for action port [ 782.843816] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d with Priority: HIGHEST for action port [ 782.846050] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.846050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.846050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.846050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.846050] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.857505] env[69756]: INFO networking_nsxv3.common.synchronization [None req-337c1d2e-e0a8-4445-9011-d6c8fe757025 None None] Enqueued Resource ID: eeee16f0-9d75-4dd3-8ace-2f28df9f12e6 with Priority: HIGHEST for action port [ 782.858661] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeee16f0-9d75-4dd3-8ace-2f28df9f12e6 with Priority: HIGHEST for action port [ 782.859365] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeee16f0-9d75-4dd3-8ace-2f28df9f12e6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.859365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeee16f0-9d75-4dd3-8ace-2f28df9f12e6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.860102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeee16f0-9d75-4dd3-8ace-2f28df9f12e6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.860102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeee16f0-9d75-4dd3-8ace-2f28df9f12e6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.860102] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeee16f0-9d75-4dd3-8ace-2f28df9f12e6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.997069] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88fedcb1-cb47-4dfc-b384-893aa7739471 [ 782.997243] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.997308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.997421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.997678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.997933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.997933] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88fedcb1-cb47-4dfc-b384-893aa7739471 already deleted. [ 782.997994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88fedcb1-cb47-4dfc-b384-893aa7739471" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.266385] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84e7e1af-e5aa-4df0-9b05-cd47bc12343f [ 783.266793] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.266888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.266888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.267684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.267684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.267684] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84e7e1af-e5aa-4df0-9b05-cd47bc12343f already deleted. [ 783.267684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84e7e1af-e5aa-4df0-9b05-cd47bc12343f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.295261] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1466bf0f-8177-4a39-85ea-b07bc9efb94c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.358333] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d [ 783.358333] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.358529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.358529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.360142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.360142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.360142] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d already deleted. [ 783.360142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df4ba3a-1a19-45b0-bc27-a455ddfa9b0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.365494] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eeee16f0-9d75-4dd3-8ace-2f28df9f12e6 [ 783.365494] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.365494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.365494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.365494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.365494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.365494] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eeee16f0-9d75-4dd3-8ace-2f28df9f12e6 already deleted. [ 783.365494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeee16f0-9d75-4dd3-8ace-2f28df9f12e6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.513912] env[69756]: INFO networking_nsxv3.common.synchronization [None req-637c4f22-0978-447f-99db-9e2e436cc7ac None None] Enqueued Resource ID: 44579737-2d9f-4ff1-8d82-bed31d626b62 with Priority: HIGHEST for action port [ 783.514211] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44579737-2d9f-4ff1-8d82-bed31d626b62 with Priority: HIGHEST for action port [ 783.514773] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-44579737-2d9f-4ff1-8d82-bed31d626b62 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.514892] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44579737-2d9f-4ff1-8d82-bed31d626b62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.514952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44579737-2d9f-4ff1-8d82-bed31d626b62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.516232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44579737-2d9f-4ff1-8d82-bed31d626b62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.516232] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44579737-2d9f-4ff1-8d82-bed31d626b62',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.801640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.801640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.801640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.801640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.801640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.801640] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c is going to be created. [ 783.834400] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.834588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.834588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.834787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.835106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.846183] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c in Status: UNINITIALIZED for 2s [ 784.020086] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44579737-2d9f-4ff1-8d82-bed31d626b62 [ 784.020310] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.020717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.020800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.021077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.021740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.022096] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44579737-2d9f-4ff1-8d82-bed31d626b62 already deleted. [ 784.022266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44579737-2d9f-4ff1-8d82-bed31d626b62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.303391] env[69756]: INFO networking_nsxv3.common.synchronization [None req-6f44af20-705b-46bb-8019-016178d38af2 tempest-ServersWithSpecificFlavorTestJSON-311311506 tempest-ServersWithSpecificFlavorTestJSON-311311506-project-member] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_rules [ 784.303391] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_rules [ 784.303391] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.305547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.305547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.305547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.305547] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.663813] env[69756]: INFO networking_nsxv3.common.synchronization [None req-41d7e4f1-6285-404f-8e10-07edf42d5a23 None None] Enqueued Resource ID: 95188a0b-04f5-4e43-85cf-73d8411c8da6 with Priority: HIGHEST for action port [ 784.664739] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95188a0b-04f5-4e43-85cf-73d8411c8da6 with Priority: HIGHEST for action port [ 784.665873] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-95188a0b-04f5-4e43-85cf-73d8411c8da6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.667781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95188a0b-04f5-4e43-85cf-73d8411c8da6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.667781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95188a0b-04f5-4e43-85cf-73d8411c8da6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.667781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95188a0b-04f5-4e43-85cf-73d8411c8da6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.667781] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95188a0b-04f5-4e43-85cf-73d8411c8da6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.768064] env[69756]: INFO networking_nsxv3.common.synchronization [None req-c2de0fd8-96a9-4c67-a3c7-1f4c91ab61a0 tempest-ServersWithSpecificFlavorTestJSON-311311506 tempest-ServersWithSpecificFlavorTestJSON-311311506-project-member] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_rules [ 784.772337] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_rules [ 784.772337] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.772337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.827023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.827366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.827961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.827961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.827961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.827961] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 already deleted. [ 784.827961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.828199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.828370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.828490] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.043180] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b0879895-2eec-4f00-996d-592d1f3b7a6c None None] Enqueued Resource ID: bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac with Priority: HIGHEST for action port [ 785.044574] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac with Priority: HIGHEST for action port [ 785.044793] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.044914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.045040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.045309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.045390] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.171922] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95188a0b-04f5-4e43-85cf-73d8411c8da6 [ 785.171922] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.171922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.171922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.171922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.171922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.171922] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95188a0b-04f5-4e43-85cf-73d8411c8da6 already deleted. [ 785.171922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95188a0b-04f5-4e43-85cf-73d8411c8da6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.208752] env[69756]: INFO networking_nsxv3.common.synchronization [req-5d5b08d8-51e7-4145-a4ac-6bc3c27791cb req-0e2eb91f-c488-4212-b914-94c04dc88213 tempest-MigrationsAdminTest-188051455 tempest-MigrationsAdminTest-188051455-project-member] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 785.209636] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 785.210285] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.210285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.210452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.210707] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.210888] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.211224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.211370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.211606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.211731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.211852] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.354442] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.354442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.354442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.354723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.354723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.354779] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 already deleted. [ 785.354843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.549803] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac [ 785.550051] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.550189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.550261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.550524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.550625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.550727] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac already deleted. [ 785.550806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd9e52eb-d644-47a8-9e10-ef8dc1c5eaac" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.716173] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.716173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.716173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.716173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.716173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.716173] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.716173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.716173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.716173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.716173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.716173] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9593-3500-4c12-99da-d35935a142b3 already deleted. [ 785.716173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.862424] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c in Status: SUCCESS [ 785.862735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.862901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.863184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.863424] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.863804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.864768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.865217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.865217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.865217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.865367] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1466bf0f-8177-4a39-85ea-b07bc9efb94c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.270671] env[69756]: INFO networking_nsxv3.common.synchronization [None req-873fe540-da71-434f-9d85-6ff81d04b545 None None] Enqueued Resource ID: 5deff18e-5890-401a-a842-ea32a4f6c5ca with Priority: HIGHEST for action port [ 786.270671] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5deff18e-5890-401a-a842-ea32a4f6c5ca with Priority: HIGHEST for action port [ 786.270866] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5deff18e-5890-401a-a842-ea32a4f6c5ca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.270866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5deff18e-5890-401a-a842-ea32a4f6c5ca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.271072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5deff18e-5890-401a-a842-ea32a4f6c5ca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.279881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5deff18e-5890-401a-a842-ea32a4f6c5ca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.279881] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5deff18e-5890-401a-a842-ea32a4f6c5ca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.341558] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.341558] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.341558] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.341817] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.342143] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.342241] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.342355] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.342613] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.342767] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.344800] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.347790] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.347790] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.347790] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.347790] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.347790] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.347790] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.369395] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466bf0f-8177-4a39-85ea-b07bc9efb94c taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.369395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.369395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.369395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.369395] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.369711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.369927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.370212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.370414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.370603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.370887] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466bf0f-8177-4a39-85ea-b07bc9efb94c taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.371181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.371375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.371713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.373021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.373021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.373021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.373021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.373021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.373527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.373802] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1466bf0f-8177-4a39-85ea-b07bc9efb94c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.376263] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.377052] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 786.377052] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.379465] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.379465] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-96662615-47b3-4fd4-91f3-3f4df9d902c1 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.379465] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-96662615-47b3-4fd4-91f3-3f4df9d902c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.379465] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-96662615-47b3-4fd4-91f3-3f4df9d902c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.379465] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-96662615-47b3-4fd4-91f3-3f4df9d902c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.379465] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96662615-47b3-4fd4-91f3-3f4df9d902c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.781575] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5deff18e-5890-401a-a842-ea32a4f6c5ca [ 786.783522] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.783522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.783522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.783522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.783781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.784351] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5deff18e-5890-401a-a842-ea32a4f6c5ca already deleted. [ 786.784351] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5deff18e-5890-401a-a842-ea32a4f6c5ca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.884427] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1466bf0f-8177-4a39-85ea-b07bc9efb94c: rpc.has_security_group_logging(os_id): False [ 786.884427] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.884427] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.884841] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.884841] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.885174] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.885174] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 96662615-47b3-4fd4-91f3-3f4df9d902c1 not found, creating... [ 786.885336] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.885535] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.885762] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.886012] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.887330] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.890440] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.890440] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.890440] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.890440] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.890440] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.890440] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 96662615-47b3-4fd4-91f3-3f4df9d902c1 is going to be created. [ 786.920324] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.923104] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.923104] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.923104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.927284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.927284] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.927284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.927284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.927284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.927284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.927284] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c is going to be created. [ 786.934668] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.934668] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.934668] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.934668] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.934668] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.934668] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-96662615-47b3-4fd4-91f3-3f4df9d902c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.045312] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.045580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.045580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.045779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.045972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.077228] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c in Status: IN_PROGRESS for 2s [ 787.278456] env[69756]: INFO networking_nsxv3.common.synchronization [req-0ec07629-0a7e-4771-95fd-c49f3c8ca0eb req-a73559b3-cf4d-45b5-8a98-c3fa5a4cbe4f tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 787.282036] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 787.286126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.286126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.286126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.286126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.286126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.286126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.286126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.286126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.287312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.287489] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.395217] env[69756]: INFO networking_nsxv3.common.synchronization [None req-bda29b09-558b-4077-b69f-5443f71a3884 None None] Enqueued Resource ID: 44b1da3c-e247-410a-aac8-6c8960eb3abe with Priority: HIGHEST for action port [ 787.397019] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b1da3c-e247-410a-aac8-6c8960eb3abe with Priority: HIGHEST for action port [ 787.397019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-44b1da3c-e247-410a-aac8-6c8960eb3abe taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.397019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44b1da3c-e247-410a-aac8-6c8960eb3abe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.397019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44b1da3c-e247-410a-aac8-6c8960eb3abe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.397019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44b1da3c-e247-410a-aac8-6c8960eb3abe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.397019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44b1da3c-e247-410a-aac8-6c8960eb3abe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.791267] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.791526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.791526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.791660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.791798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.792772] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.792772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.792772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.792772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.792772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.792772] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 already deleted. [ 787.792772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.899008] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44b1da3c-e247-410a-aac8-6c8960eb3abe [ 787.899267] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.899459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.899459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.899812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.900072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.900072] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44b1da3c-e247-410a-aac8-6c8960eb3abe already deleted. [ 787.900180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44b1da3c-e247-410a-aac8-6c8960eb3abe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.070492] env[69756]: INFO networking_nsxv3.common.synchronization [None req-1e0e9bec-2dc0-4cb5-a845-a3445412b6ba None None] Enqueued Resource ID: 32e633c0-1388-4242-a68a-6f41d565fc4d with Priority: HIGHEST for action port [ 788.070492] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e633c0-1388-4242-a68a-6f41d565fc4d with Priority: HIGHEST for action port [ 788.070771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-32e633c0-1388-4242-a68a-6f41d565fc4d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.070832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32e633c0-1388-4242-a68a-6f41d565fc4d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.071065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32e633c0-1388-4242-a68a-6f41d565fc4d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.073035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32e633c0-1388-4242-a68a-6f41d565fc4d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.073035] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e633c0-1388-4242-a68a-6f41d565fc4d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.235197] env[69756]: INFO networking_nsxv3.common.synchronization [None req-a1e87788-a2aa-4821-a776-c47d31b30f9b None None] Enqueued Resource ID: 5b76cd35-3f03-4945-8e77-275983a67f73 with Priority: HIGHEST for action port [ 788.235598] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b76cd35-3f03-4945-8e77-275983a67f73 with Priority: HIGHEST for action port [ 788.236111] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b76cd35-3f03-4945-8e77-275983a67f73 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.236264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b76cd35-3f03-4945-8e77-275983a67f73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.236417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b76cd35-3f03-4945-8e77-275983a67f73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.236599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b76cd35-3f03-4945-8e77-275983a67f73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.236703] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b76cd35-3f03-4945-8e77-275983a67f73',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.575979] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32e633c0-1388-4242-a68a-6f41d565fc4d [ 788.576260] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.576412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.576483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.576783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.576950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.577035] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32e633c0-1388-4242-a68a-6f41d565fc4d already deleted. [ 788.577227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32e633c0-1388-4242-a68a-6f41d565fc4d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.715886] env[69756]: INFO networking_nsxv3.common.synchronization [req-5d5b08d8-51e7-4145-a4ac-6bc3c27791cb req-78757e2b-ad97-4068-beb5-75e61dffcbe6 service nova] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_rules [ 788.715886] env[69756]: INFO networking_nsxv3.common.synchronization [req-5d5b08d8-51e7-4145-a4ac-6bc3c27791cb req-78757e2b-ad97-4068-beb5-75e61dffcbe6 service nova] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 788.716037] env[69756]: INFO networking_nsxv3.common.synchronization [req-5d5b08d8-51e7-4145-a4ac-6bc3c27791cb req-78757e2b-ad97-4068-beb5-75e61dffcbe6 service nova] Enqueued Resource ID: 96662615-47b3-4fd4-91f3-3f4df9d902c1 with Priority: HIGHEST for action port [ 788.716649] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_rules [ 788.716855] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 788.717128] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96662615-47b3-4fd4-91f3-3f4df9d902c1 with Priority: HIGHEST for action port [ 788.717783] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.717783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.717936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.718182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.718274] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.719490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.719971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.719971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.720125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.720306] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.720474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.720584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.720858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.721095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.721184] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.723589] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-96662615-47b3-4fd4-91f3-3f4df9d902c1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.723589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96662615-47b3-4fd4-91f3-3f4df9d902c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.723589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96662615-47b3-4fd4-91f3-3f4df9d902c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.723589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96662615-47b3-4fd4-91f3-3f4df9d902c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.723589] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96662615-47b3-4fd4-91f3-3f4df9d902c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.727868] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.728734] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-506" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.728734] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-506" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.729059] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-506" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.729477] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.729557] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.729799] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.730199] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.730480] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.730840] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.731092] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.731284] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.731492] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.731688] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.732087] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.732150] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.739943] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b76cd35-3f03-4945-8e77-275983a67f73 [ 788.740676] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.740866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.740981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.741345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.742195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.742294] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b76cd35-3f03-4945-8e77-275983a67f73 already deleted. [ 788.742783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b76cd35-3f03-4945-8e77-275983a67f73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.756148] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.756359] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 788.756451] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.756635] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-506" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.757385] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-037cdecf-d2c1-4cc4-b247-845cc278dc58 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.757905] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.757905] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.759036] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.759036] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('037cdecf-d2c1-4cc4-b247-845cc278dc58',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.776105] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b3497e83-77ea-4369-87f6-a853e2195dc9 tempest-ServerActionsV293TestJSON-543463791 tempest-ServerActionsV293TestJSON-543463791-project-member] Enqueued Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_rules [ 788.776583] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_rules [ 788.784747] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.784919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.784987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.785284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.785368] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.867211] env[69756]: INFO networking_nsxv3.common.synchronization [None req-fdc5ce5f-c648-439d-960a-cb1c982c8885 tempest-ServersTestBootFromVolume-553600348 tempest-ServersTestBootFromVolume-553600348-project-member] Enqueued Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_rules [ 788.867714] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_rules [ 788.868018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.868185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.868231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.868448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.868522] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.871990] env[69756]: INFO networking_nsxv3.common.synchronization [req-daeca408-5cb3-4953-add4-d5bfd3e09b06 req-dc6840cc-f0d6-4149-ac54-a4e8769ef464 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 788.874018] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 788.874018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.874018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.874018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.874018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.874233] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.878028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.878028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.878028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.878028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.878028] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.994331] env[69756]: INFO networking_nsxv3.common.synchronization [None req-ef127cb9-8c80-40df-ade1-81527289976a tempest-ServerActionsV293TestJSON-543463791 tempest-ServerActionsV293TestJSON-543463791-project-member] Enqueued Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_rules [ 788.994331] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_rules [ 788.994944] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.995246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.052626] env[69756]: INFO networking_nsxv3.common.synchronization [None req-a10734d3-7d65-4fca-b7d3-5e0e4afd5fd6 tempest-ServersTestBootFromVolume-553600348 tempest-ServersTestBootFromVolume-553600348-project-member] Enqueued Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_rules [ 789.053527] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_rules [ 789.053875] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.053996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.091279] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c in Status: SUCCESS [ 789.092475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.224597] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.225976] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.226200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.235976] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96662615-47b3-4fd4-91f3-3f4df9d902c1 with status ACTIVE [ 789.236222] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.236359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.236425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.236646] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.236736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.236929] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.237039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.237099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.237255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.237330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.237506] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.237601] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.237668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.238013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.238013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.238013] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96662615-47b3-4fd4-91f3-3f4df9d902c1 is going to be updated. [ 789.260360] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.260582] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.260721] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.261041] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.261196] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.261349] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 037cdecf-d2c1-4cc4-b247-845cc278dc58 not found, creating... [ 789.261603] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.261754] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.262013] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.262104] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.262236] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.262512] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.262661] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.262772] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.263374] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.263600] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.263818] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 is going to be created. [ 789.267330] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.267770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.268098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.268695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.268852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.269094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96662615-47b3-4fd4-91f3-3f4df9d902c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.290939] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.291181] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.291309] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.292081] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.292502] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.292796] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.313013] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.314076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.314076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.314076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.314076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.314076] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 already deleted. [ 789.314076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.314076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.314076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.314076] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.377184] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.378109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.378109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.378109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.378109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.378109] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.378109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.378109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.378426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.378426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.378426] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba already deleted. [ 789.378426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.410071] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.410071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.410071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.410296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.411726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.411726] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 already deleted. [ 789.411726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.411726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.411726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.411726] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.728072] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.838400] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.838400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.838400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.838400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.838400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.838400] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 already deleted. [ 789.838596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.944489] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.944657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.946845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.946845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.946845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.946845] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 already deleted. [ 789.946845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.095214] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.096463] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-524" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.096463] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-524" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.097380] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-524" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.097761] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.097962] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.098099] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.098839] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.098839] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.098839] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.098839] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.099034] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.099106] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.099228] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.099334] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.099472] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.124135] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.124405] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.124591] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.124674] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-524" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.127792] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-96305b43-c3a0-469c-a862-ad77b7e72f03 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.127792] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.128438] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.128438] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.128438] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96305b43-c3a0-469c-a862-ad77b7e72f03',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.131398] env[69756]: INFO networking_nsxv3.common.synchronization [None req-4fa80157-b0da-467f-a54b-006724f9d9e6 None None] Enqueued Resource ID: e67353ad-8c3c-48e7-a858-d4d5f3953ca5 with Priority: HIGHEST for action port [ 790.131398] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e67353ad-8c3c-48e7-a858-d4d5f3953ca5 with Priority: HIGHEST for action port [ 790.131936] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e67353ad-8c3c-48e7-a858-d4d5f3953ca5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.132024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e67353ad-8c3c-48e7-a858-d4d5f3953ca5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.132024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e67353ad-8c3c-48e7-a858-d4d5f3953ca5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.132274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e67353ad-8c3c-48e7-a858-d4d5f3953ca5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.132355] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e67353ad-8c3c-48e7-a858-d4d5f3953ca5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.237418] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.237418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.237418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.237418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.237418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.237418] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9593-3500-4c12-99da-d35935a142b3 is going to be created. [ 790.264036] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.264036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.264036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.264036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.264036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.276228] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: UNINITIALIZED for 2s [ 790.638134] env[69756]: INFO networking_nsxv3.common.synchronization [req-0ec07629-0a7e-4771-95fd-c49f3c8ca0eb req-ee01b7fc-4cd8-4971-8c47-f624953a1dcd service nova] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 790.638134] env[69756]: INFO networking_nsxv3.common.synchronization [req-0ec07629-0a7e-4771-95fd-c49f3c8ca0eb req-ee01b7fc-4cd8-4971-8c47-f624953a1dcd service nova] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 790.638134] env[69756]: INFO networking_nsxv3.common.synchronization [req-0ec07629-0a7e-4771-95fd-c49f3c8ca0eb req-ee01b7fc-4cd8-4971-8c47-f624953a1dcd service nova] Enqueued Resource ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 with Priority: HIGHEST for action port [ 790.638134] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.638134] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.638134] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.638134] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.638134] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.638134] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 96305b43-c3a0-469c-a862-ad77b7e72f03 not found, creating... [ 790.638929] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.638929] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.638929] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.638929] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.639247] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.644108] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.644353] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.644529] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.645896] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.645896] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.645896] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 is going to be created. [ 790.647907] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e67353ad-8c3c-48e7-a858-d4d5f3953ca5 [ 790.647907] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.647907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.647907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.647907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.647907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.647907] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e67353ad-8c3c-48e7-a858-d4d5f3953ca5 already deleted. [ 790.647907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e67353ad-8c3c-48e7-a858-d4d5f3953ca5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.647907] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 790.648291] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 790.648291] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 with Priority: HIGHEST for action port [ 790.650131] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.650131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.650131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.650131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.650131] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.650902] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.650902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.650902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.650902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.650902] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.651384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.651384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.651384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.651384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.651384] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.652947] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-037cdecf-d2c1-4cc4-b247-845cc278dc58 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.652947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.652947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.652947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.652947] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('037cdecf-d2c1-4cc4-b247-845cc278dc58',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.676041] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.676264] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.676390] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.676686] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.676936] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.678230] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.098957] env[69756]: INFO networking_nsxv3.common.synchronization [req-543a3073-19f9-4cb2-8572-190745a88473 req-c0f3793a-a5a4-48fd-9699-72ee67f1b492 tempest-ServersAdminTestJSON-2109728624 tempest-ServersAdminTestJSON-2109728624-project-member] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 791.098957] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 791.099899] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.099899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.099899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.099899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.099899] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.099899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.099899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.100357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.102447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.102447] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.158261] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.158261] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.158261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.158261] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 037cdecf-d2c1-4cc4-b247-845cc278dc58 with status ACTIVE [ 791.158261] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.158261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.158261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.158553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.158553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.158553] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.158703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.158703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.158844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.159186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.159413] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.159520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.159581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.159752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.159922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.159922] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 is going to be updated. [ 791.196568] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.196568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.196568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.196854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.196854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.197875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.608390] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.608590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.608988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.609239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.609486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.609715] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.609829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.610158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.610158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.610253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.610287] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 already deleted. [ 791.610376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.662446] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.112215] env[69756]: INFO networking_nsxv3.common.synchronization [None req-a751b9e8-b2fc-46cf-b42a-94fe71c6decc None None] Enqueued Resource ID: 9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94 with Priority: HIGHEST for action port [ 792.113347] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94 with Priority: HIGHEST for action port [ 792.114602] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.115240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.116120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.116120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.117569] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.169207] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.169207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.169207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.169207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.169207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.169207] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 is going to be created. [ 792.208257] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.208405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.208471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.209040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.209040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.227138] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: UNINITIALIZED for 2s [ 792.232230] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.232382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.232485] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.233210] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.236588] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.236588] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.236588] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.236588] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.236588] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.236588] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.236588] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.236588] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.236588] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.236588] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.236588] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.236588] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.272919] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.273660] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.273863] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.274435] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.274946] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.275193] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.275310] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.275951] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.276136] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c1a9d7b-7c6c-4e26-a627-adffb41e113a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.300754] env[69756]: INFO networking_nsxv3.common.synchronization [req-daeca408-5cb3-4953-add4-d5bfd3e09b06 req-ce09076c-407e-43cf-8d65-7fc8495ec535 service nova] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 792.301094] env[69756]: INFO networking_nsxv3.common.synchronization [req-daeca408-5cb3-4953-add4-d5bfd3e09b06 req-ce09076c-407e-43cf-8d65-7fc8495ec535 service nova] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 792.301620] env[69756]: INFO networking_nsxv3.common.synchronization [req-daeca408-5cb3-4953-add4-d5bfd3e09b06 req-ce09076c-407e-43cf-8d65-7fc8495ec535 service nova] Enqueued Resource ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 with Priority: HIGHEST for action port [ 792.301620] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 792.301620] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 792.301782] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 with Priority: HIGHEST for action port [ 792.304417] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: SUCCESS [ 792.304640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.305147] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.305296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.305362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.305627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.305775] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.306873] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.307048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.307157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.308286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.308286] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.308286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.308538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.308538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.308726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.308726] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.310103] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-96305b43-c3a0-469c-a862-ad77b7e72f03 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.310876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.310876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.311075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.311129] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96305b43-c3a0-469c-a862-ad77b7e72f03',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.314524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.314524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.314524] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.314524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.314524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.315040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.315040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.315511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.315511] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.619723] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94 [ 792.620033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.620173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.620276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.620778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.620778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.620962] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94 already deleted. [ 792.620962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f6c058d-d9a8-4c3a-9faa-c4ea7f876f94" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.784537] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.784537] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.784537] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.784537] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.784537] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.784537] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 4c1a9d7b-7c6c-4e26-a627-adffb41e113a not found, creating... [ 792.784537] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.787697] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.787697] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.789429] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.791791] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.791791] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.791791] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.791791] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.791791] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.791791] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.791791] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 4c1a9d7b-7c6c-4e26-a627-adffb41e113a is going to be created. [ 792.817255] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.817595] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.817808] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.818403] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.818819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.819120] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.820455] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.820598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.821471] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.821886] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96305b43-c3a0-469c-a862-ad77b7e72f03 with status ACTIVE [ 792.822164] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.822352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.822440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.822668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.822786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.822974] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.824105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.824202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.827050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.827050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.827050] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.827050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.827050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.827050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.827050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.827050] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 is going to be updated. [ 792.836189] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.836397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.836495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.837134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.837134] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.837134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.837964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.838206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.838345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.838516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.838634] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.838733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.838795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.838952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.840188] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.840307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.841140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.841405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.841537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.841666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.841844] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.853468] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.855258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.855258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.855258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.855258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.855258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.327291] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.345771] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cced9593-3500-4c12-99da-d35935a142b3: rpc.has_security_group_logging(os_id): False [ 793.366061] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.366235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.366319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.366839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.366839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.366839] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.366969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.367009] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.367636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.367636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.369763] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.369763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.369912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.371491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.371831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.372070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.372070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.372070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.372269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.372352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.373202] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cced9593-3500-4c12-99da-d35935a142b3 is going to be created. [ 793.438265] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.438265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.438265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.438265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.438432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.454812] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: IN_PROGRESS for 2s [ 793.661910] env[69756]: INFO networking_nsxv3.common.synchronization [req-019b3f29-cdd0-42e5-81b7-915ecb7ca405 req-f5977dd8-276d-4417-835d-85e69c4fcb28 tempest-DeleteServersAdminTestJSON-507097304 tempest-DeleteServersAdminTestJSON-507097304-project-admin] Enqueued Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 793.663093] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 793.663093] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.663093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.663848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.664221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.664542] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.666610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.666610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.666610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.666610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.666610] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.833142] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.833142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.833142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.833142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.833142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.833142] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be created. [ 793.860655] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.860655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.860655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.860655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.860655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.871326] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: UNINITIALIZED for 2s [ 793.903239] env[69756]: INFO networking_nsxv3.common.synchronization [req-543a3073-19f9-4cb2-8572-190745a88473 req-78cc5eb6-4929-48b3-a3cb-23e08cd7d374 service nova] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_rules [ 793.903239] env[69756]: INFO networking_nsxv3.common.synchronization [req-543a3073-19f9-4cb2-8572-190745a88473 req-78cc5eb6-4929-48b3-a3cb-23e08cd7d374 service nova] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 793.903239] env[69756]: INFO networking_nsxv3.common.synchronization [req-543a3073-19f9-4cb2-8572-190745a88473 req-78cc5eb6-4929-48b3-a3cb-23e08cd7d374 service nova] Enqueued Resource ID: 4c1a9d7b-7c6c-4e26-a627-adffb41e113a with Priority: HIGHEST for action port [ 793.903239] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_rules [ 793.903239] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 793.903239] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1a9d7b-7c6c-4e26-a627-adffb41e113a with Priority: HIGHEST for action port [ 793.903725] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.903992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.904153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.904482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.904652] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.905624] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.905893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.906069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.906336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.906584] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.906815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.907056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.907287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.907458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.907920] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.909257] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.909563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.909726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.909969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.912359] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c1a9d7b-7c6c-4e26-a627-adffb41e113a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.970742] env[69756]: INFO networking_nsxv3.common.synchronization [None req-83ae6a35-179f-4952-af8d-a26748387df1 None None] Enqueued Resource ID: 36eac0d5-e81b-4233-bff8-0c61dacd49c6 with Priority: HIGHEST for action port [ 793.971302] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36eac0d5-e81b-4233-bff8-0c61dacd49c6 with Priority: HIGHEST for action port [ 793.971640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-36eac0d5-e81b-4233-bff8-0c61dacd49c6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.971764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36eac0d5-e81b-4233-bff8-0c61dacd49c6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.971832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36eac0d5-e81b-4233-bff8-0c61dacd49c6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.972458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36eac0d5-e81b-4233-bff8-0c61dacd49c6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.972512] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36eac0d5-e81b-4233-bff8-0c61dacd49c6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.988023] env[69756]: INFO networking_nsxv3.common.synchronization [req-0bfb10a1-65e1-4c9a-9f3a-059f1d8add83 req-261edf6a-e68a-49b2-8064-bdbfca100dba tempest-ServerDiagnosticsNegativeTest-1637113848 tempest-ServerDiagnosticsNegativeTest-1637113848-project-member] Enqueued Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGHEST for action security_group_members [ 793.988023] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGHEST for action security_group_members [ 793.988670] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cf7e80-866c-4475-93d6-8e9e3254cf79 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.988791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.988856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.989127] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.989282] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.989380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.989440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.989677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.989677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.989757] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73cf7e80-866c-4475-93d6-8e9e3254cf79',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.167666] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.167666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.167666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.167666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.167666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.168021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.168021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.168021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.168231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.168231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.168292] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bf1989-7e31-4042-8158-612d65438abc is going to be updated. [ 794.221694] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.224122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.224122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.224122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.224122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.242312] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: IN_PROGRESS for 2s [ 794.246380] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: SUCCESS [ 794.246380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.246380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.246380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.246380] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.246380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.246380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.247661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.247921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.248123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.248123] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.409315] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.409673] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.411133] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.411450] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.411750] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.412022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.412077] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.412295] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.413038] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.413038] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.413038] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.413038] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.413038] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.413237] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.413276] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.413376] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.415294] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.422979] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.422979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.422979] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c1a9d7b-7c6c-4e26-a627-adffb41e113a with status ACTIVE [ 794.422979] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.422979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.422979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.422979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.422979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.423469] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.423469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.423469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.423469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.423656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.423802] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.423802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.423991] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.423991] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.424110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.424178] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c1a9d7b-7c6c-4e26-a627-adffb41e113a is going to be updated. [ 794.447949] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.447949] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.447949] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.448346] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.448719] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-5e35f24a-eb85-40f4-9327-498d7d6e7732 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.449366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-5e35f24a-eb85-40f4-9327-498d7d6e7732" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.449366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-5e35f24a-eb85-40f4-9327-498d7d6e7732" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.449443] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-5e35f24a-eb85-40f4-9327-498d7d6e7732" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.449672] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e35f24a-eb85-40f4-9327-498d7d6e7732',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.455875] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.455875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.455875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.456536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.456536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.456536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c1a9d7b-7c6c-4e26-a627-adffb41e113a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.475635] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36eac0d5-e81b-4233-bff8-0c61dacd49c6 [ 794.476150] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.476352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.476352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.476576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.476636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.476799] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36eac0d5-e81b-4233-bff8-0c61dacd49c6 already deleted. [ 794.476799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36eac0d5-e81b-4233-bff8-0c61dacd49c6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.492039] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.492199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.492242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.492616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.492616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.492771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.493459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.493459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.494557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.494682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.494713] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 already deleted. [ 794.495025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.691381] env[69756]: INFO networking_nsxv3.common.synchronization [None req-56fb8fb5-8ec2-4a3c-8dde-d4a26d1385e5 None None] Enqueued Resource ID: 334e5ad1-cf46-4ed4-8b1d-df505a082fc3 with Priority: HIGHEST for action port [ 794.691381] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334e5ad1-cf46-4ed4-8b1d-df505a082fc3 with Priority: HIGHEST for action port [ 794.691640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-334e5ad1-cf46-4ed4-8b1d-df505a082fc3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.691640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-334e5ad1-cf46-4ed4-8b1d-df505a082fc3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.691640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-334e5ad1-cf46-4ed4-8b1d-df505a082fc3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.691877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-334e5ad1-cf46-4ed4-8b1d-df505a082fc3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.692375] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334e5ad1-cf46-4ed4-8b1d-df505a082fc3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.753625] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.927598] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.962382] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.962382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.962382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.962382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.962382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.962382] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 5e35f24a-eb85-40f4-9327-498d7d6e7732 not found, creating... [ 794.962840] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.963977] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.965643] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.967050] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.967050] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.967050] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.967050] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.967050] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.967880] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.967880] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.967880] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 5e35f24a-eb85-40f4-9327-498d7d6e7732 is going to be created. [ 794.994863] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.994863] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.994863] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.994863] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.994863] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.994863] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-5e35f24a-eb85-40f4-9327-498d7d6e7732" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.195090] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 334e5ad1-cf46-4ed4-8b1d-df505a082fc3 [ 795.198023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.198023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.198023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.198023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.198023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.198023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:334e5ad1-cf46-4ed4-8b1d-df505a082fc3 already deleted. [ 795.198023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-334e5ad1-cf46-4ed4-8b1d-df505a082fc3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.256191] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cae8dc5-dcca-4592-aebe-26bb46462d80: rpc.has_security_group_logging(os_id): False [ 795.289037] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.289037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.289037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.289037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.289037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.289037] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.289037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.289037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.289037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.289037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.289037] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 is going to be created. [ 795.361709] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.361964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.361964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.362930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.362930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.383014] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: IN_PROGRESS for 2s [ 795.430811] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.431178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.431178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.431339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.431431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.431533] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be created. [ 795.472920] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: SUCCESS [ 795.474022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.482839] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.483021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.483098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.483337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.483501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.500248] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: UNINITIALIZED for 2s [ 795.885023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 795.885415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.885733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.886574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.886873] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.887134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.888676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.888815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.888911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.889088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.889274] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.909647] env[69756]: INFO networking_nsxv3.common.synchronization [req-0bfb10a1-65e1-4c9a-9f3a-059f1d8add83 req-9563d669-35e3-45a4-b508-b0959c54e6d3 service nova] Enqueued Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGHEST for action security_group_rules [ 795.909827] env[69756]: INFO networking_nsxv3.common.synchronization [req-0bfb10a1-65e1-4c9a-9f3a-059f1d8add83 req-9563d669-35e3-45a4-b508-b0959c54e6d3 service nova] Enqueued Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGHEST for action security_group_members [ 795.909968] env[69756]: INFO networking_nsxv3.common.synchronization [req-0bfb10a1-65e1-4c9a-9f3a-059f1d8add83 req-9563d669-35e3-45a4-b508-b0959c54e6d3 service nova] Enqueued Resource ID: 5e35f24a-eb85-40f4-9327-498d7d6e7732 with Priority: HIGHEST for action port [ 795.910550] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGHEST for action security_group_rules [ 795.914715] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGHEST for action security_group_members [ 795.914715] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e35f24a-eb85-40f4-9327-498d7d6e7732 with Priority: HIGHEST for action port [ 795.914715] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73cf7e80-866c-4475-93d6-8e9e3254cf79 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.914884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.914884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.915144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.915224] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73cf7e80-866c-4475-93d6-8e9e3254cf79',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.916693] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cf7e80-866c-4475-93d6-8e9e3254cf79 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.917304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.917420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.917571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.917758] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.917996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.918110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.918268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.918357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.918449] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73cf7e80-866c-4475-93d6-8e9e3254cf79',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.920060] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e35f24a-eb85-40f4-9327-498d7d6e7732 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.920060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e35f24a-eb85-40f4-9327-498d7d6e7732" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.920060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e35f24a-eb85-40f4-9327-498d7d6e7732" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.920320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e35f24a-eb85-40f4-9327-498d7d6e7732" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.920320] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e35f24a-eb85-40f4-9327-498d7d6e7732',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.255934] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: SUCCESS [ 796.256156] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bf1989-7e31-4042-8158-612d65438abc deletion is rescheduled due to dependency. [ 796.256287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.391471] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.391622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.391694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.391924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.392109] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.392217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.392283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.392464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.392557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.392635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.392808] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.392996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.392996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.393153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.393245] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.393337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.393397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.393537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.393626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.393739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.393824] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.420341] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73cf7e80-866c-4475-93d6-8e9e3254cf79',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.421371] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cf7e80-866c-4475-93d6-8e9e3254cf79 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.421486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.423085] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e35f24a-eb85-40f4-9327-498d7d6e7732 with status ACTIVE [ 796.423085] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.423085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.423273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.423355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.423443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.423614] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.423712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.423784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.423938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.424023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.424201] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.424290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.424348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.424484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.424554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.424638] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e35f24a-eb85-40f4-9327-498d7d6e7732 is going to be updated. [ 796.452955] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.452955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.452955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.452955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.452955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.454660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e35f24a-eb85-40f4-9327-498d7d6e7732" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.896623] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85796156-67df-4d82-b494-0ea64303f9ba: rpc.has_security_group_logging(os_id): False [ 796.916574] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.916574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.916574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.916574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.917060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.917060] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.917060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.917060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.917264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.917264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.919859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.919859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.919859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.919859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.919859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.919859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.919859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.919859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.919859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.919859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.919859] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be created. [ 796.928024] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73cf7e80-866c-4475-93d6-8e9e3254cf79',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.993149] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.993149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.993149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.993149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.994056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.010675] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 797.398278] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: SUCCESS [ 797.398278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.433135] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.433342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.433484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.433957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.434069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.434176] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 is going to be created. [ 797.472349] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.472850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.472850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.472981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.473493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.485318] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 in Status: UNINITIALIZED for 2s [ 797.511372] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 797.511661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.513498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.513498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.513498] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.513498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.513498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.515468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.515468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.515468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.515468] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.963077] env[69756]: INFO networking_nsxv3.common.synchronization [None req-0d2cfb1d-1805-416d-9590-bf2838b40193 None None] Enqueued Resource ID: b04cda98-18b2-437d-b63e-8a994a5c4dd0 with Priority: HIGHEST for action port [ 797.963077] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b04cda98-18b2-437d-b63e-8a994a5c4dd0 with Priority: HIGHEST for action port [ 797.963663] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b04cda98-18b2-437d-b63e-8a994a5c4dd0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.963780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b04cda98-18b2-437d-b63e-8a994a5c4dd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.963875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b04cda98-18b2-437d-b63e-8a994a5c4dd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.965409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b04cda98-18b2-437d-b63e-8a994a5c4dd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.965492] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b04cda98-18b2-437d-b63e-8a994a5c4dd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.020571] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.020571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.020571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.021390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.021920] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.021920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.021920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.022148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.022620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.022620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.022620] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.022620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.022620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.022779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.022854] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.022947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.023032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.023162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.023238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.023333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.023399] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.113250] env[69756]: INFO networking_nsxv3.common.synchronization [None req-faea06d8-7fce-4b3e-9be9-8617cafce754 None None] Enqueued Resource ID: f57e1778-56ad-4f08-bcf7-88042a0b3af4 with Priority: HIGHEST for action port [ 798.113804] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f57e1778-56ad-4f08-bcf7-88042a0b3af4 with Priority: HIGHEST for action port [ 798.114198] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f57e1778-56ad-4f08-bcf7-88042a0b3af4 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.114279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f57e1778-56ad-4f08-bcf7-88042a0b3af4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.114317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f57e1778-56ad-4f08-bcf7-88042a0b3af4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.114583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f57e1778-56ad-4f08-bcf7-88042a0b3af4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.114654] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f57e1778-56ad-4f08-bcf7-88042a0b3af4',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.468597] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b04cda98-18b2-437d-b63e-8a994a5c4dd0 [ 798.469489] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.470812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.470812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.470812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.470812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.470812] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b04cda98-18b2-437d-b63e-8a994a5c4dd0 already deleted. [ 798.470812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b04cda98-18b2-437d-b63e-8a994a5c4dd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.529205] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734: rpc.has_security_group_logging(os_id): False [ 798.552373] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.552611] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.552717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.553026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.553166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.553471] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.553632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.553729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.553976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.554119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.554437] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.554590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.554691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.554954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.555060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.555341] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.555495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.555593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.555832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.555959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.556234] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be created. [ 798.618333] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f57e1778-56ad-4f08-bcf7-88042a0b3af4 [ 798.618333] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.618535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.618535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.618667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.618754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.618851] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f57e1778-56ad-4f08-bcf7-88042a0b3af4 already deleted. [ 798.618955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f57e1778-56ad-4f08-bcf7-88042a0b3af4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.621525] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.621678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.621741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.622064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.622223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.636055] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 799.025298] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 799.026529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.496843] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 in Status: SUCCESS [ 799.497138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.497345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.497577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.497797] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.497922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.497984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.498167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.498245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.498340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.498440] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73cf7e80-866c-4475-93d6-8e9e3254cf79',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.002334] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cf7e80-866c-4475-93d6-8e9e3254cf79 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.002742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.002742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.003609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.003832] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.003952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.004039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.004296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.004679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.004806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.005011] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cf7e80-866c-4475-93d6-8e9e3254cf79 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.005213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.005213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.005404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.005668] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.005831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.005831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.006369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.006369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.006369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.006369] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73cf7e80-866c-4475-93d6-8e9e3254cf79',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.380018] env[69756]: INFO networking_nsxv3.common.synchronization [req-bb96ae34-a8f9-4faf-8b52-472357f7809a req-82771e7d-615d-4869-ab50-375e58d839f6 tempest-ServersAdminTestJSON-2109728624 tempest-ServersAdminTestJSON-2109728624-project-member] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 800.380542] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 800.380845] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.380972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.383127] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.383452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.383899] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.383899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.383899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.384133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.384133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.384133] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.450082] env[69756]: INFO networking_nsxv3.common.synchronization [None req-1de4747b-9e19-4e5c-a453-d9fb60345ef0 None None] Enqueued Resource ID: e37f2490-8baf-4f5e-a09e-5c3158d5d7f4 with Priority: HIGHEST for action port [ 800.451212] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e37f2490-8baf-4f5e-a09e-5c3158d5d7f4 with Priority: HIGHEST for action port [ 800.451212] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e37f2490-8baf-4f5e-a09e-5c3158d5d7f4 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.451212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e37f2490-8baf-4f5e-a09e-5c3158d5d7f4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.457028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e37f2490-8baf-4f5e-a09e-5c3158d5d7f4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.460021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e37f2490-8baf-4f5e-a09e-5c3158d5d7f4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.460021] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e37f2490-8baf-4f5e-a09e-5c3158d5d7f4',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.510408] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73cf7e80-866c-4475-93d6-8e9e3254cf79: rpc.has_security_group_logging(os_id): False [ 800.527855] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.527855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.528038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.528257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.528321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.528659] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.528659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.528659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.530444] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.530444] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.530444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.530444] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 is going to be created. [ 800.591999] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.592750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.592839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.593027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.593243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.612978] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 in Status: IN_PROGRESS for 2s [ 800.649596] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 800.651643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.886428] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.959823] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e37f2490-8baf-4f5e-a09e-5c3158d5d7f4 [ 800.960118] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.960250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.960323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.960827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.960827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.960827] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e37f2490-8baf-4f5e-a09e-5c3158d5d7f4 already deleted. [ 800.960827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e37f2490-8baf-4f5e-a09e-5c3158d5d7f4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.225225] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.225225] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.225578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.225612] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.225960] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.226901] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.226990] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.227311] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.227570] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.227785] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.227932] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.229094] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.229094] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.229094] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.229094] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.229094] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.250332] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.250332] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.250332] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.250566] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.251357] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-39ae1a76-473c-48c8-a6b7-b032742461ef taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.251760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-39ae1a76-473c-48c8-a6b7-b032742461ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.252038] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-39ae1a76-473c-48c8-a6b7-b032742461ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.252434] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-39ae1a76-473c-48c8-a6b7-b032742461ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.252653] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ae1a76-473c-48c8-a6b7-b032742461ef',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.389577] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.759653] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.759916] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.760014] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.760310] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.760854] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.760854] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 39ae1a76-473c-48c8-a6b7-b032742461ef not found, creating... [ 801.760999] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.761095] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.761208] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.763157] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.763157] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.763157] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.763157] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.763157] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.763157] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.763157] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.763157] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 39ae1a76-473c-48c8-a6b7-b032742461ef is going to be created. [ 801.788681] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.791177] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.791177] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.791177] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.791177] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.791177] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-39ae1a76-473c-48c8-a6b7-b032742461ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.897163] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.897163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.897163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.897394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.897681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.897785] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 801.942680] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.942680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.942680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.942680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.942680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.973361] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 802.632170] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 in Status: SUCCESS [ 802.632485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.016526] env[69756]: INFO networking_nsxv3.common.synchronization [req-bb96ae34-a8f9-4faf-8b52-472357f7809a req-8915a472-ee66-4dea-8663-3e5079ba153e service nova] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_rules [ 803.016526] env[69756]: INFO networking_nsxv3.common.synchronization [req-bb96ae34-a8f9-4faf-8b52-472357f7809a req-8915a472-ee66-4dea-8663-3e5079ba153e service nova] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 803.016526] env[69756]: INFO networking_nsxv3.common.synchronization [req-bb96ae34-a8f9-4faf-8b52-472357f7809a req-8915a472-ee66-4dea-8663-3e5079ba153e service nova] Enqueued Resource ID: 39ae1a76-473c-48c8-a6b7-b032742461ef with Priority: HIGHEST for action port [ 803.017061] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_rules [ 803.017215] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 803.017376] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39ae1a76-473c-48c8-a6b7-b032742461ef with Priority: HIGHEST for action port [ 803.017597] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.017717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.017782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.017995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.018686] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.019648] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.019752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.019944] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-39ae1a76-473c-48c8-a6b7-b032742461ef taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.020061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39ae1a76-473c-48c8-a6b7-b032742461ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.020128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39ae1a76-473c-48c8-a6b7-b032742461ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.020321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39ae1a76-473c-48c8-a6b7-b032742461ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.020451] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ae1a76-473c-48c8-a6b7-b032742461ef',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.368352] env[69756]: INFO networking_nsxv3.common.synchronization [req-a33f7ac3-5b5b-4f24-a06b-dba2e38d0c30 req-a3010cef-c514-4479-95a7-5f093325b630 tempest-ServerExternalEventsTest-668827054 tempest-ServerExternalEventsTest-668827054-project-member] Enqueued Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGHEST for action security_group_members [ 803.368906] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGHEST for action security_group_members [ 803.369231] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1505824-b2af-43e9-86e7-eba6fd16c230 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.369357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.369427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.369675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.369903] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.370188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.370188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.373195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.373195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.373498] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1505824-b2af-43e9-86e7-eba6fd16c230',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.525249] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.525924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.525924] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39ae1a76-473c-48c8-a6b7-b032742461ef with status ACTIVE [ 803.525924] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.526116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.526151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.526357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.526447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.526631] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.526748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.526827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.527086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.527157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.527344] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.527722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.527722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.527722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.527722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.527865] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39ae1a76-473c-48c8-a6b7-b032742461ef is going to be updated. [ 803.550038] env[69756]: INFO networking_nsxv3.common.synchronization [None req-ada55b89-fedf-46f8-bfa3-47f258bee2f7 None None] Enqueued Resource ID: b3f219e8-52ce-43ab-bd33-41696e8b77d0 with Priority: HIGHEST for action port [ 803.551098] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3f219e8-52ce-43ab-bd33-41696e8b77d0 with Priority: HIGHEST for action port [ 803.551468] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3f219e8-52ce-43ab-bd33-41696e8b77d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.551599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3f219e8-52ce-43ab-bd33-41696e8b77d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.552049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3f219e8-52ce-43ab-bd33-41696e8b77d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.552487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3f219e8-52ce-43ab-bd33-41696e8b77d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.552561] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3f219e8-52ce-43ab-bd33-41696e8b77d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.555305] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.555451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.555591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.556404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.556404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.556404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39ae1a76-473c-48c8-a6b7-b032742461ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.875711] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.876082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.876082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.876208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.876304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.876530] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.876696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.876761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.876934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.877047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.877140] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1505824-b2af-43e9-86e7-eba6fd16c230 already deleted. [ 803.877287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.982494] env[69756]: INFO networking_nsxv3.common.synchronization [req-9a26188e-3f22-4ff7-8ad3-5b5d4e17abc5 req-b88e180f-5b05-44f7-a707-d312e36668df tempest-AttachInterfacesV270Test-1182665717 tempest-AttachInterfacesV270Test-1182665717-project-member] Enqueued Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGHEST for action security_group_members [ 803.982494] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGHEST for action security_group_members [ 803.982494] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466bf0f-8177-4a39-85ea-b07bc9efb94c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.982494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.982494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.982494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.984925] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.986394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.986394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.988627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.988627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.988627] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466bf0f-8177-4a39-85ea-b07bc9efb94c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.992648] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 803.992754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.993861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.993861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.993861] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.993861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.993861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.994065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.994149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.994392] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.055067] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3f219e8-52ce-43ab-bd33-41696e8b77d0 [ 804.055067] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.055173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.055173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.055427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.059857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.059857] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3f219e8-52ce-43ab-bd33-41696e8b77d0 already deleted. [ 804.059857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3f219e8-52ce-43ab-bd33-41696e8b77d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.064223] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.064223] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.064223] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.064223] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.064513] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.064770] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.065261] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.065599] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.065745] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.066058] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.066183] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.066346] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.066499] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.069674] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.069674] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.069674] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.090319] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.090501] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 804.090773] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.091595] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.091855] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.092117] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.092626] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.093541] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.093541] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f099fc0-b147-4c2e-93e4-ddb1c04119d6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.497393] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.497654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.497759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.498065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.498513] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.499792] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.500057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.500098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.500443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.501026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.501164] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c is going to be updated. [ 804.503934] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.544036] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.544036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.544036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.544036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.544036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.557128] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c in Status: IN_PROGRESS for 2s [ 804.595853] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.596202] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.596386] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.596635] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.596785] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.596972] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 8f099fc0-b147-4c2e-93e4-ddb1c04119d6 not found, creating... [ 804.597272] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.597438] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.597987] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.597987] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.597987] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.598203] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.598802] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.602324] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.602528] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.603032] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.603032] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 8f099fc0-b147-4c2e-93e4-ddb1c04119d6 is going to be created. [ 804.638259] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.638665] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.638846] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.639696] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.639696] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.639876] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.007519] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.511134] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.511311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.511402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.511731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.511731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.511889] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 805.546306] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.546850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.546970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.547175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.547304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.559938] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 805.661077] env[69756]: INFO networking_nsxv3.common.synchronization [req-a33f7ac3-5b5b-4f24-a06b-dba2e38d0c30 req-bb7f7608-4c3f-4969-9e6f-50ce2c15039e service nova] Enqueued Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGHEST for action security_group_rules [ 805.661270] env[69756]: INFO networking_nsxv3.common.synchronization [req-a33f7ac3-5b5b-4f24-a06b-dba2e38d0c30 req-bb7f7608-4c3f-4969-9e6f-50ce2c15039e service nova] Enqueued Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGHEST for action security_group_members [ 805.661411] env[69756]: INFO networking_nsxv3.common.synchronization [req-a33f7ac3-5b5b-4f24-a06b-dba2e38d0c30 req-bb7f7608-4c3f-4969-9e6f-50ce2c15039e service nova] Enqueued Resource ID: 8f099fc0-b147-4c2e-93e4-ddb1c04119d6 with Priority: HIGHEST for action port [ 805.662166] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGHEST for action security_group_rules [ 805.662166] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGHEST for action security_group_members [ 805.662166] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f099fc0-b147-4c2e-93e4-ddb1c04119d6 with Priority: HIGHEST for action port [ 805.662512] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1505824-b2af-43e9-86e7-eba6fd16c230 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.662609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.662609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.662878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.662958] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1505824-b2af-43e9-86e7-eba6fd16c230',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.663851] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1505824-b2af-43e9-86e7-eba6fd16c230 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.664028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.664128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.664785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.664785] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.664785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.664785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.664785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.664785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.665254] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1505824-b2af-43e9-86e7-eba6fd16c230',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.669055] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.669055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.669055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.669055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.669055] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f099fc0-b147-4c2e-93e4-ddb1c04119d6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.870080] env[69756]: INFO networking_nsxv3.common.synchronization [req-736ed979-3547-4834-85bb-a34ee290a34a req-671b477f-e8ad-4832-91aa-852a75eb5012 tempest-VolumesAssistedSnapshotsTest-1545684772 tempest-VolumesAssistedSnapshotsTest-1545684772-project-member] Enqueued Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_members [ 805.870080] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_members [ 805.870080] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fd17e7b-8910-4529-a801-b80ed3d29a0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.870333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.870333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.870665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.870935] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.871151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.871295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.871553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.871767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.871955] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.168380] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1505824-b2af-43e9-86e7-eba6fd16c230 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.168794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.168794] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1505824-b2af-43e9-86e7-eba6fd16c230',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.169573] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f099fc0-b147-4c2e-93e4-ddb1c04119d6 with status ACTIVE [ 806.169768] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.173067] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.173067] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.173067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.173067] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f099fc0-b147-4c2e-93e4-ddb1c04119d6 is going to be updated. [ 806.210282] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.210506] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.210553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.210794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.210945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.211136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f099fc0-b147-4c2e-93e4-ddb1c04119d6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.374509] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.374667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.374737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.374985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.375157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.375368] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.375505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.375602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.375796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.375909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.376016] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e already deleted. [ 806.376127] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.555767] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-748 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.556100] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-748" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.556310] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-748" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.556746] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-748" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.558737] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.559362] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.559444] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.559780] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.559876] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.560103] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.560237] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.560360] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.560483] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.560608] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.560726] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.560869] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.573230] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c in Status: SUCCESS [ 806.573426] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c deletion is rescheduled due to dependency. [ 806.573561] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.590499] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.590754] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.590934] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.591201] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-748" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.591603] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-a654feb0-296b-452d-a274-5b2de5e6abd2 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.593523] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-a654feb0-296b-452d-a274-5b2de5e6abd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.593760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-a654feb0-296b-452d-a274-5b2de5e6abd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.594020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-a654feb0-296b-452d-a274-5b2de5e6abd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.595297] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a654feb0-296b-452d-a274-5b2de5e6abd2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.674440] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1505824-b2af-43e9-86e7-eba6fd16c230',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.690510] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8d6b88db-5ce5-462e-b865-5e5bb95508fd None None] Enqueued Resource ID: 5852338b-eac4-4306-bdc8-ea08f536b987 with Priority: HIGHEST for action port [ 806.690764] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5852338b-eac4-4306-bdc8-ea08f536b987 with Priority: HIGHEST for action port [ 806.691420] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5852338b-eac4-4306-bdc8-ea08f536b987 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.691628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5852338b-eac4-4306-bdc8-ea08f536b987" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.691628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5852338b-eac4-4306-bdc8-ea08f536b987" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.691963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5852338b-eac4-4306-bdc8-ea08f536b987" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.691963] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5852338b-eac4-4306-bdc8-ea08f536b987',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.100957] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.102530] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.102762] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.103358] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.103358] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.103529] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port a654feb0-296b-452d-a274-5b2de5e6abd2 not found, creating... [ 807.103894] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.104139] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.104696] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.104696] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.104842] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.105109] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.105295] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.105895] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.105895] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.105895] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.107110] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: a654feb0-296b-452d-a274-5b2de5e6abd2 is going to be created. [ 807.135072] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.135303] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.135483] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.135824] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.136172] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.136426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-a654feb0-296b-452d-a274-5b2de5e6abd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.183725] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.183725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.183725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.183725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.183725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.183725] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1505824-b2af-43e9-86e7-eba6fd16c230 is going to be created. [ 807.197484] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5852338b-eac4-4306-bdc8-ea08f536b987 [ 807.197484] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.197484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.197484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.197484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.197484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.197484] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5852338b-eac4-4306-bdc8-ea08f536b987 already deleted. [ 807.197484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5852338b-eac4-4306-bdc8-ea08f536b987" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.226848] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.227039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.227378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.227378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.227488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.262346] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1505824-b2af-43e9-86e7-eba6fd16c230 in Status: UNINITIALIZED for 2s [ 807.482829] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f12720d-ec60-4dd7-a11e-18de3eba2c5c req-2ac723df-8035-4d5d-b42d-c0dfa6471487 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 807.484807] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f12720d-ec60-4dd7-a11e-18de3eba2c5c req-2ac723df-8035-4d5d-b42d-c0dfa6471487 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 807.485494] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 807.485656] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 807.491028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.491028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.491028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.491028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.491028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.491028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.492533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.492533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.492533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.492533] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.493087] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.493180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.493224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.493487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.493687] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.493794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.495690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.495690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.495690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.495690] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.571614] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 807.571819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.572032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.574551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.574771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.574901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.574967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.575165] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.575244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.575334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.575422] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.686161] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f12720d-ec60-4dd7-a11e-18de3eba2c5c req-2ac723df-8035-4d5d-b42d-c0dfa6471487 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 807.686161] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f12720d-ec60-4dd7-a11e-18de3eba2c5c req-2ac723df-8035-4d5d-b42d-c0dfa6471487 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 807.686161] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f12720d-ec60-4dd7-a11e-18de3eba2c5c req-2ac723df-8035-4d5d-b42d-c0dfa6471487 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_rules [ 807.686864] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f12720d-ec60-4dd7-a11e-18de3eba2c5c req-2ac723df-8035-4d5d-b42d-c0dfa6471487 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 807.687277] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f12720d-ec60-4dd7-a11e-18de3eba2c5c req-2ac723df-8035-4d5d-b42d-c0dfa6471487 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 with Priority: HIGHEST for action port [ 807.687720] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 807.687969] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_rules [ 807.688188] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 with Priority: HIGHEST for action port [ 807.688306] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 807.688387] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 807.688714] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.688871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.689032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.689209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.689263] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.692662] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.692662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.692662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.692992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.692992] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.694087] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-96305b43-c3a0-469c-a862-ad77b7e72f03 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.694210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.694263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.694481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.694563] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96305b43-c3a0-469c-a862-ad77b7e72f03',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.695813] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.696240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.696240] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.696240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.997031] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.999474] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.082384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.082384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.082384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.082384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.082384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.082929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.082929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.082929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.082929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.082929] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.198352] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.199071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.199071] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.199071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.199481] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96305b43-c3a0-469c-a862-ad77b7e72f03 with status ACTIVE [ 808.199634] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.199716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.199823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.200718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.200718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.200718] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.200718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.200718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.200969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.200969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.201228] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.201365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.201455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.201909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.202065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.202181] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 is going to be updated. [ 808.225814] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.226079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.226133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.226332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.226464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.226650] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.500739] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.502856] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.585099] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734: rpc.has_security_group_logging(os_id): False [ 808.605303] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.605565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.605565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.605781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.605906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.606112] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.606217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.606292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.606526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.606629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.606911] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.607442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.607442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.607442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.607442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.607646] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.607787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.607829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.607992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.608106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.608197] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 808.696593] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.699180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.699180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.699180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.699180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.713652] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 808.746354] env[69756]: INFO networking_nsxv3.common.synchronization [req-736ed979-3547-4834-85bb-a34ee290a34a req-7fd4da23-0a14-4821-be7f-846a2757c0b3 service nova] Enqueued Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_rules [ 808.746354] env[69756]: INFO networking_nsxv3.common.synchronization [req-736ed979-3547-4834-85bb-a34ee290a34a req-7fd4da23-0a14-4821-be7f-846a2757c0b3 service nova] Enqueued Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_members [ 808.746354] env[69756]: INFO networking_nsxv3.common.synchronization [req-736ed979-3547-4834-85bb-a34ee290a34a req-7fd4da23-0a14-4821-be7f-846a2757c0b3 service nova] Enqueued Resource ID: a654feb0-296b-452d-a274-5b2de5e6abd2 with Priority: HIGHEST for action port [ 808.746462] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_rules [ 808.747341] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_members [ 808.747341] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a654feb0-296b-452d-a274-5b2de5e6abd2 with Priority: HIGHEST for action port [ 808.747341] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.747894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.748119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.748366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.748477] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.749937] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fd17e7b-8910-4529-a801-b80ed3d29a0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.750166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.750166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.750377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.750551] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.750730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.750730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.750897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.750988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.751098] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.754526] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a654feb0-296b-452d-a274-5b2de5e6abd2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.754526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a654feb0-296b-452d-a274-5b2de5e6abd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.754526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a654feb0-296b-452d-a274-5b2de5e6abd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.754526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a654feb0-296b-452d-a274-5b2de5e6abd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.754526] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a654feb0-296b-452d-a274-5b2de5e6abd2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.757856] env[69756]: INFO networking_nsxv3.common.synchronization [req-1e1b9f97-968b-4d67-b291-38ba1ded0a4e req-c937f6c6-9000-48f8-aaf5-c42e21c80992 tempest-ServersWithSpecificFlavorTestJSON-311311506 tempest-ServersWithSpecificFlavorTestJSON-311311506-project-member] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 808.758648] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 808.758982] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.759290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.759290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.759510] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.759624] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.759748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.759896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.760042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.760042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.760166] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.007937] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.008217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.008217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.009406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.009406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.009406] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 809.011818] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.011953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.012927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.013250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.013614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.014179] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce is going to be created. [ 809.048241] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.048349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.048410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.048592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.048746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.050674] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.050801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.050874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.051159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.051518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.063054] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 809.064693] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: UNINITIALIZED for 2s [ 809.258749] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.259249] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fd17e7b-8910-4529-a801-b80ed3d29a0e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.259316] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.259477] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a654feb0-296b-452d-a274-5b2de5e6abd2 with status ACTIVE [ 809.259642] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.259744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.259809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.260029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.260156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.260338] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.260433] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.260492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.260661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.260735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.260918] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.261020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.261080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.261222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.261291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.261371] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a654feb0-296b-452d-a274-5b2de5e6abd2 is going to be updated. [ 809.263984] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.264107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.264185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.264624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.264624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.264624] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.264783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.264783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.264867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.268020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.268020] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 already deleted. [ 809.268020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.277119] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1505824-b2af-43e9-86e7-eba6fd16c230 in Status: SUCCESS [ 809.277417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.277519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.277763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.277927] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.278078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.278119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.279317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.279317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.279317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.279317] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1505824-b2af-43e9-86e7-eba6fd16c230',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.285671] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.285671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.285671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.285671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.285671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.285671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a654feb0-296b-452d-a274-5b2de5e6abd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.592151] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.592151] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-859" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.592151] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-859" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.592424] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-859" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.592821] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.593037] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.593949] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.593949] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.593949] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.593949] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.593949] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.593949] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.594254] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.594254] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.594457] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.594512] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.614369] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.614369] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.614521] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.614777] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-859" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.615797] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.615797] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.615797] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.619325] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.619325] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d530ebb6-e1fc-463b-ba3f-69c0f64656ef',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.764616] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.783389] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1505824-b2af-43e9-86e7-eba6fd16c230 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.783698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.783698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.783890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.784085] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.785970] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1505824-b2af-43e9-86e7-eba6fd16c230 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.785970] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.785970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.785970] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1505824-b2af-43e9-86e7-eba6fd16c230',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.908853] env[69756]: INFO networking_nsxv3.common.synchronization [None req-c6e1db60-0fc8-4414-a04d-86224b047780 None None] Enqueued Resource ID: 0479aed2-0311-4033-8570-7101e099376d with Priority: HIGHEST for action port [ 809.909151] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0479aed2-0311-4033-8570-7101e099376d with Priority: HIGHEST for action port [ 809.909728] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-0479aed2-0311-4033-8570-7101e099376d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.909857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0479aed2-0311-4033-8570-7101e099376d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.909924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0479aed2-0311-4033-8570-7101e099376d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.913022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0479aed2-0311-4033-8570-7101e099376d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.913022] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0479aed2-0311-4033-8570-7101e099376d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.042655] env[69756]: INFO networking_nsxv3.common.synchronization [None req-41c1e742-1607-47fe-95ff-a3d95b64c57e None None] Enqueued Resource ID: 580252ff-2842-4c61-a235-88dc60d05e0a with Priority: HIGHEST for action port [ 810.044778] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580252ff-2842-4c61-a235-88dc60d05e0a with Priority: HIGHEST for action port [ 810.045302] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-580252ff-2842-4c61-a235-88dc60d05e0a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.045486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-580252ff-2842-4c61-a235-88dc60d05e0a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.045638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-580252ff-2842-4c61-a235-88dc60d05e0a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.045979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-580252ff-2842-4c61-a235-88dc60d05e0a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.046413] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('580252ff-2842-4c61-a235-88dc60d05e0a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.082506] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 810.085624] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc with Priority: HIGHEST for action security_group_members [ 810.085624] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 810.085624] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 810.085995] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc with Priority: HIGHEST for action security_group_members [ 810.086824] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 810.086824] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.086824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.088532] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.088706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.088913] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.089126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.089328] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.089512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.089664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.090826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.090826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.090826] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.091249] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.091864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.123845] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.123845] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.123845] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.124334] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.127616] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.127616] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port d530ebb6-e1fc-463b-ba3f-69c0f64656ef not found, creating... [ 810.127616] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.127616] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.127616] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.127616] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.127616] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.127616] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.127616] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.127616] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.128012] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.128012] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.128012] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: d530ebb6-e1fc-463b-ba3f-69c0f64656ef is going to be created. [ 810.165080] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.165080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.165080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.165080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.165438] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.165731] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.202870] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc with Priority: HIGHEST for action security_group_rules [ 810.203235] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc with Priority: HIGHEST for action security_group_members [ 810.203633] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 810.203633] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 810.203931] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_rules [ 810.204966] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 810.205308] env[69756]: INFO networking_nsxv3.common.synchronization [req-538114cc-15de-4f1c-87ab-3bb99a0cd183 req-3272d24a-2755-49b6-a244-87384f896d6b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 with Priority: HIGHEST for action port [ 810.207364] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc with Priority: HIGHEST for action security_group_rules [ 810.207544] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 810.207799] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 810.207941] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 with Priority: HIGHEST for action port [ 810.208810] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_rules [ 810.209010] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc with Priority: HIGHEST for action security_group_members [ 810.209200] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 810.209685] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b6578e8-a78e-4c09-82f2-a7faaacca9bc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.209876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.209971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.210700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.210700] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.215084] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.215084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.215084] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.215084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.215084] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-96305b43-c3a0-469c-a862-ad77b7e72f03 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.215084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.215084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.215084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.215084] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96305b43-c3a0-469c-a862-ad77b7e72f03',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.216785] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.217085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.217138] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.217194] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.217372] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.217451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.268249] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.268598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.268598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.268774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.268817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.268888] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e is going to be created. [ 810.293140] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1505824-b2af-43e9-86e7-eba6fd16c230: rpc.has_security_group_logging(os_id): False [ 810.297921] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.297921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.298460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.298946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.299243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.312339] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e in Status: UNINITIALIZED for 2s [ 810.315244] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.315244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.315244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.315244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.315244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.315466] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.315466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.315548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.316185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.316185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.316185] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.316185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.316185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.316416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.316416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.316509] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.316605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.316662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.316804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.316882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.316968] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1505824-b2af-43e9-86e7-eba6fd16c230 is going to be created. [ 810.409889] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.410115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.410115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.410349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.410545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.413319] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0479aed2-0311-4033-8570-7101e099376d [ 810.413566] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.413700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.413770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.414119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.414208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.414373] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0479aed2-0311-4033-8570-7101e099376d already deleted. [ 810.414436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0479aed2-0311-4033-8570-7101e099376d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425635] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1505824-b2af-43e9-86e7-eba6fd16c230 in Status: IN_PROGRESS for 2s [ 810.549093] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 580252ff-2842-4c61-a235-88dc60d05e0a [ 810.549366] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.549508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.549579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.549812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.550069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.550069] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:580252ff-2842-4c61-a235-88dc60d05e0a already deleted. [ 810.550178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-580252ff-2842-4c61-a235-88dc60d05e0a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.594311] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.720422] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96305b43-c3a0-469c-a862-ad77b7e72f03 with status ACTIVE [ 810.720614] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.720756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.720827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.721081] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.721178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.721374] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.721481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.721551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.721713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.721798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.721987] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.722102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.722154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.722323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.722442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.722573] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96305b43-c3a0-469c-a862-ad77b7e72f03 is going to be updated. [ 810.728096] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.728293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.731013] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 810.731013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.750747] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.750747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.750747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.750747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.750747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.750747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96305b43-c3a0-469c-a862-ad77b7e72f03" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.079511] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: SUCCESS [ 811.079511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.079511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.079511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.079511] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.079511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.079511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.079814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.079814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.079814] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.082011] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 811.082848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.082848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.082848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.082848] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.082848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.082848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.083163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.083163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.083322] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.101374] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.310904] env[69756]: INFO networking_nsxv3.common.synchronization [req-1e1b9f97-968b-4d67-b291-38ba1ded0a4e req-62c4c7eb-091f-4050-8bdd-f7e423d18ce2 service nova] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_rules [ 811.310904] env[69756]: INFO networking_nsxv3.common.synchronization [req-1e1b9f97-968b-4d67-b291-38ba1ded0a4e req-62c4c7eb-091f-4050-8bdd-f7e423d18ce2 service nova] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 811.310904] env[69756]: INFO networking_nsxv3.common.synchronization [req-1e1b9f97-968b-4d67-b291-38ba1ded0a4e req-62c4c7eb-091f-4050-8bdd-f7e423d18ce2 service nova] Enqueued Resource ID: d530ebb6-e1fc-463b-ba3f-69c0f64656ef with Priority: HIGHEST for action port [ 811.310904] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_rules [ 811.310904] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 811.310904] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d530ebb6-e1fc-463b-ba3f-69c0f64656ef with Priority: HIGHEST for action port [ 811.310904] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.310904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.310904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.310904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.310904] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.312467] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.312606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.312660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.312857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.313024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.313135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.313193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.313348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.313610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.313610] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.314400] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.314480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.314528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.314680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.316348] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d530ebb6-e1fc-463b-ba3f-69c0f64656ef',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.585198] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.586326] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.603696] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.603902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.604058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.604192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.604283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.604384] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc is going to be created. [ 811.631406] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.631579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.631654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.632143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.632386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.644952] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc in Status: UNINITIALIZED for 2s [ 811.818072] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.818287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.818413] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.822998] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d530ebb6-e1fc-463b-ba3f-69c0f64656ef with status ACTIVE [ 811.823209] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.823329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.823395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.823612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.823697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.823958] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.824050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.824110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.824270] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.824341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.824513] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.824600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.824657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.824791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.824858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.824937] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d530ebb6-e1fc-463b-ba3f-69c0f64656ef is going to be updated. [ 811.849656] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.849778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.849853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.850097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.850232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.850392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d530ebb6-e1fc-463b-ba3f-69c0f64656ef" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.088843] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.094408] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.320462] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.324449] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e in Status: SUCCESS [ 812.324691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.324771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.324965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.325198] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.325345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.325411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.325588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.325674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.325764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.325855] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.443241] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1505824-b2af-43e9-86e7-eba6fd16c230 in Status: SUCCESS [ 812.445875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.597273] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.597273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.597618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.597618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.597618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.597742] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 812.599190] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.599190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.599190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.599462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.599462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.599540] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce is going to be updated. [ 812.636241] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.636241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.636241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.636241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.637372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.639496] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.639826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.639826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.640116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.640256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.652274] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: IN_PROGRESS for 2s [ 812.653096] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 812.713478] env[69756]: INFO networking_nsxv3.common.synchronization [None req-1a13f35b-968f-40d5-a286-a68022b210b5 None None] Enqueued Resource ID: 46de0386-fe8a-4b10-b757-fdb6480affb3 with Priority: HIGHEST for action port [ 812.713657] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46de0386-fe8a-4b10-b757-fdb6480affb3 with Priority: HIGHEST for action port [ 812.714030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-46de0386-fe8a-4b10-b757-fdb6480affb3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.715210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46de0386-fe8a-4b10-b757-fdb6480affb3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.715210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46de0386-fe8a-4b10-b757-fdb6480affb3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.715210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46de0386-fe8a-4b10-b757-fdb6480affb3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.715327] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46de0386-fe8a-4b10-b757-fdb6480affb3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.823166] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.823384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.823430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.823689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.823800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.823908] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 is going to be created. [ 812.828834] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.848506] env[69756]: INFO networking_nsxv3.common.synchronization [req-6c391583-a46f-4bf5-b017-c6e181f47a01 req-866089a4-9ed8-4106-ab94-cb2d86efad34 tempest-ImagesNegativeTestJSON-434328599 tempest-ImagesNegativeTestJSON-434328599-project-member] Enqueued Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGHEST for action security_group_members [ 812.849143] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGHEST for action security_group_members [ 812.849699] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-69eeba93-f93f-45ab-9cb2-242c52429094 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.849931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.850121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.850385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.850608] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.850857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.850857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.851142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.852255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.852255] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69eeba93-f93f-45ab-9cb2-242c52429094',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.854215] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.854509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.854627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.855229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.855518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.868833] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: UNINITIALIZED for 2s [ 813.219070] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46de0386-fe8a-4b10-b757-fdb6480affb3 [ 813.219268] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.220856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.220856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.221150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.221150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.221214] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46de0386-fe8a-4b10-b757-fdb6480affb3 already deleted. [ 813.221310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46de0386-fe8a-4b10-b757-fdb6480affb3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.335048] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fd17e7b-8910-4529-a801-b80ed3d29a0e: rpc.has_security_group_logging(os_id): False [ 813.355626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.355897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.355897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.356571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.356571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.356780] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.356892] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.357149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.357412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.357500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.357638] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69eeba93-f93f-45ab-9cb2-242c52429094 already deleted. [ 813.357737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.360134] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.360134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.360134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.360134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.360134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.362986] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.363305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.363385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.363926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.364904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.364904] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e is going to be created. [ 813.442195] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.442416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.442475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.442771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.443033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.460351] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e in Status: IN_PROGRESS for 2s [ 813.582987] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-100 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.584819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-100" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.588032] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-100" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.588032] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-100" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.588032] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.588032] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.588498] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.589596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.589596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.589596] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.589596] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.589874] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.590067] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.590322] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.590543] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.590837] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.624080] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.624080] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 813.624080] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.624080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-100" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.625095] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-bd42e200-d38b-4382-9d37-ce438f323a22 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.625505] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-bd42e200-d38b-4382-9d37-ce438f323a22" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.625668] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-bd42e200-d38b-4382-9d37-ce438f323a22" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.626221] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-bd42e200-d38b-4382-9d37-ce438f323a22" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.626425] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd42e200-d38b-4382-9d37-ce438f323a22',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.664917] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc in Status: SUCCESS [ 813.664917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.664917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.664917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.664917] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.664917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.664917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.664917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.664917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.664917] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.130643] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.130932] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.131088] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.131524] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.131783] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.132090] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port bd42e200-d38b-4382-9d37-ce438f323a22 not found, creating... [ 814.132393] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.132618] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.132727] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.133040] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.133204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.133584] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.133793] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.134141] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.134440] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.134606] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.134807] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: bd42e200-d38b-4382-9d37-ce438f323a22 is going to be created. [ 814.161270] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.161696] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.162035] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.163321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.163321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.163321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-bd42e200-d38b-4382-9d37-ce438f323a22" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.167900] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.416565] env[69756]: INFO networking_nsxv3.common.synchronization [None req-9a660b1e-4e3e-43e0-98d3-0a2d668208f1 None None] Enqueued Resource ID: ff8e8c01-ae58-4557-8e24-718f8c678838 with Priority: HIGHEST for action port [ 814.417279] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff8e8c01-ae58-4557-8e24-718f8c678838 with Priority: HIGHEST for action port [ 814.417582] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff8e8c01-ae58-4557-8e24-718f8c678838 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.417816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff8e8c01-ae58-4557-8e24-718f8c678838" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.417816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff8e8c01-ae58-4557-8e24-718f8c678838" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.418068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff8e8c01-ae58-4557-8e24-718f8c678838" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.418178] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff8e8c01-ae58-4557-8e24-718f8c678838',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.669759] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: SUCCESS [ 814.670056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.670958] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 814.671152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.671396] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.672436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.674687] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.674941] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.675088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.676250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.676498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.676582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.676689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.676885] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.677763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.677971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.678152] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.678299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.678380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.679553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.680242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.680357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.680437] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.682610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.682610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.682745] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.682840] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.682840] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.683011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.683089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.683187] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.684136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.684317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.684482] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.684588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.684664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.684788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.684853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.684999] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.882032] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: SUCCESS [ 814.882032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.882032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.882032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.882032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.882032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.882032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.882032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.882032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.882032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.882032] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.921548] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff8e8c01-ae58-4557-8e24-718f8c678838 [ 814.921548] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.921548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.921548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.921548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.921548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.921548] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff8e8c01-ae58-4557-8e24-718f8c678838 already deleted. [ 814.921548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff8e8c01-ae58-4557-8e24-718f8c678838" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.182932] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.189306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.189306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.189306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.189306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.189306] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc is going to be updated. [ 815.189306] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.191079] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.191079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.191079] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.192737] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.231774] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.231774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.231774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.231774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.231774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.244643] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc in Status: IN_PROGRESS for 2s [ 815.385843] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.475851] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e in Status: SUCCESS [ 815.475851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.534427] env[69756]: INFO networking_nsxv3.common.synchronization [req-89ec262d-3481-4d21-a46e-61a1854d0c63 req-81a8ec30-8d4c-42e6-a1e8-b816fd2026da tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 815.534427] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 815.534427] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.539037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.539037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.539037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.539037] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.539037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.539037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.539037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.539037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.539037] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.549300] env[69756]: INFO networking_nsxv3.common.synchronization [req-6c391583-a46f-4bf5-b017-c6e181f47a01 req-cdbac4ab-c3d0-4143-8e45-704c2f14746f service nova] Enqueued Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGHEST for action security_group_rules [ 815.549300] env[69756]: INFO networking_nsxv3.common.synchronization [req-6c391583-a46f-4bf5-b017-c6e181f47a01 req-cdbac4ab-c3d0-4143-8e45-704c2f14746f service nova] Enqueued Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGHEST for action security_group_members [ 815.549300] env[69756]: INFO networking_nsxv3.common.synchronization [req-6c391583-a46f-4bf5-b017-c6e181f47a01 req-cdbac4ab-c3d0-4143-8e45-704c2f14746f service nova] Enqueued Resource ID: bd42e200-d38b-4382-9d37-ce438f323a22 with Priority: HIGHEST for action port [ 815.549300] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGHEST for action security_group_rules [ 815.549300] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGHEST for action security_group_members [ 815.549300] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd42e200-d38b-4382-9d37-ce438f323a22 with Priority: HIGHEST for action port [ 815.549300] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69eeba93-f93f-45ab-9cb2-242c52429094 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.549300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.549300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.553118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.553337] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69eeba93-f93f-45ab-9cb2-242c52429094',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.554130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-69eeba93-f93f-45ab-9cb2-242c52429094 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.554552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.554552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.554552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.554695] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.554753] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.554791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.555042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.555042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.555144] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69eeba93-f93f-45ab-9cb2-242c52429094',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.555843] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd42e200-d38b-4382-9d37-ce438f323a22 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.555940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd42e200-d38b-4382-9d37-ce438f323a22" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.556044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd42e200-d38b-4382-9d37-ce438f323a22" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.556226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd42e200-d38b-4382-9d37-ce438f323a22" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.556339] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd42e200-d38b-4382-9d37-ce438f323a22',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.695959] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88b9f358-c151-4b1c-adb6-6e05b22ab1ce: rpc.has_security_group_logging(os_id): False [ 815.697165] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.698045] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.721222] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.721385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.721480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.721688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.721782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.722007] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.722440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.722520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.722693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.722817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.722912] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce is going to be created. [ 815.773094] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.773252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.774436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.778517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.778517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.792913] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: IN_PROGRESS for 2s [ 815.889112] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47f4cc8e-dc8b-42c2-a280-bec009884679: rpc.has_security_group_logging(os_id): False [ 815.917958] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.918217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.918326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.918579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.918706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.919086] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.920651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.920651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.920651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.920858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.920858] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 is going to be created. [ 815.982084] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.982084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.982084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.982259] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.982335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.998791] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: IN_PROGRESS for 2s [ 816.043582] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.043766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.043838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.044130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.044230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.044428] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.044529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.044594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.044757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.044835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.044919] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f already deleted. [ 816.045006] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.059923] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-69eeba93-f93f-45ab-9cb2-242c52429094 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.059923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.062024] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd42e200-d38b-4382-9d37-ce438f323a22 with status ACTIVE [ 816.062024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.062024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.062024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.062024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.062024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.062024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.062024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.062024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.062024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.062024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.062024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.062493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.063071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.063256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.063341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.063422] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd42e200-d38b-4382-9d37-ce438f323a22 is going to be updated. [ 816.068466] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69eeba93-f93f-45ab-9cb2-242c52429094',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.072105] env[69756]: INFO networking_nsxv3.common.synchronization [req-cb94a9a4-731a-43d3-acf8-4cd59f47b3bc req-614e7e1f-a818-45ba-964f-fea8efe18fe1 tempest-ServerDiagnosticsNegativeTest-1637113848 tempest-ServerDiagnosticsNegativeTest-1637113848-project-member] Enqueued Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGHEST for action security_group_members [ 816.072105] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGHEST for action security_group_members [ 816.072105] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cf7e80-866c-4475-93d6-8e9e3254cf79 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.076550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.076550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.076550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.077336] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.077548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.077548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.077676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.077727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.077800] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73cf7e80-866c-4475-93d6-8e9e3254cf79',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.120157] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.120157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.120157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.120157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.120406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.120406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd42e200-d38b-4382-9d37-ce438f323a22" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.168243] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.168243] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.168243] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.168243] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.168424] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.168483] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.168589] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.168812] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.168939] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.169176] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.169288] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.169405] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.169502] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.169604] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.169707] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.169835] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.188386] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.188557] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.188714] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.188904] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.189271] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.189452] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.189571] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.189900] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.190058] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.200214] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.200214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.200214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.200489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.200489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.200577] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce is going to be updated. [ 816.201884] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.202065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.202126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.202277] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.202361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.202452] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 816.265925] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.265925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.265925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.265925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.266420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.269463] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.269463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.269463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.269463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.269463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.281292] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 816.281292] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: IN_PROGRESS for 2s [ 816.574084] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69eeba93-f93f-45ab-9cb2-242c52429094',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.584544] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.584544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.584544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.584544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.584544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.584544] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.584544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.584544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.584544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.584544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.584544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 is going to be updated. [ 816.612238] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.612641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.612843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.613227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.613636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.636832] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 in Status: IN_PROGRESS for 2s [ 816.695024] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.695024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.695024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.695024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.695024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.695024] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d not found, creating... [ 816.695024] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.695024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.695024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.695024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.695024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.695647] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.695934] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.696335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.698520] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.698520] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.698520] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d is going to be created. [ 816.723308] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.723578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.723796] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.725509] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.725509] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.725509] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.079990] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.080308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.080381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.080568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.081099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.081099] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69eeba93-f93f-45ab-9cb2-242c52429094 is going to be created. [ 817.111436] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.111436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.111436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.111586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.111672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.123466] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69eeba93-f93f-45ab-9cb2-242c52429094 in Status: UNINITIALIZED for 2s [ 817.174240] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e3837e13-cccf-406b-9195-1081ea91d931 None None] Enqueued Resource ID: ab6a78ac-55e2-498f-95c3-c214e0e3626d with Priority: HIGHEST for action port [ 817.174240] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab6a78ac-55e2-498f-95c3-c214e0e3626d with Priority: HIGHEST for action port [ 817.174240] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab6a78ac-55e2-498f-95c3-c214e0e3626d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.174240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab6a78ac-55e2-498f-95c3-c214e0e3626d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.174240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab6a78ac-55e2-498f-95c3-c214e0e3626d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.176902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab6a78ac-55e2-498f-95c3-c214e0e3626d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.176902] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab6a78ac-55e2-498f-95c3-c214e0e3626d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.276258] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc in Status: SUCCESS [ 817.276431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.279103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.279103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.279103] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.279103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.279103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.279103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.279103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.279103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.279103] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.680951] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab6a78ac-55e2-498f-95c3-c214e0e3626d [ 817.681269] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.681566] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.681566] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.681708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.681744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.681834] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab6a78ac-55e2-498f-95c3-c214e0e3626d already deleted. [ 817.681915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab6a78ac-55e2-498f-95c3-c214e0e3626d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.782544] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.809502] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: SUCCESS [ 817.809739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.809908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.810170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.810241] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.019469] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: SUCCESS [ 818.019697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.232439] env[69756]: INFO networking_nsxv3.common.synchronization [req-89ec262d-3481-4d21-a46e-61a1854d0c63 req-9871cf3f-ced7-4a92-b6df-cd6469b78c55 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 818.232439] env[69756]: INFO networking_nsxv3.common.synchronization [req-89ec262d-3481-4d21-a46e-61a1854d0c63 req-9871cf3f-ced7-4a92-b6df-cd6469b78c55 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 818.232599] env[69756]: INFO networking_nsxv3.common.synchronization [req-89ec262d-3481-4d21-a46e-61a1854d0c63 req-9871cf3f-ced7-4a92-b6df-cd6469b78c55 service nova] Enqueued Resource ID: a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d with Priority: HIGHEST for action port [ 818.233219] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 818.233358] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 818.233468] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d with Priority: HIGHEST for action port [ 818.233727] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.233852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.233939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.234548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.234635] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.235557] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.235666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.236118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.236118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.236118] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.236318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.236318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.236393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.236448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.236560] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.237369] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.237474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.237539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.237697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.237806] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.286260] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b6578e8-a78e-4c09-82f2-a7faaacca9bc: rpc.has_security_group_logging(os_id): False [ 818.293154] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 818.294112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.294397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.294553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.294706] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.294830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.294894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.295075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.295252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.295252] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.296855] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: SUCCESS [ 818.297424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.299137] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.299320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.300555] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.301136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.301136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.301136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.301136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.301136] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.314943] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.316444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.317038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.317184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.317256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.317553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.317658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.317887] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.317993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.318070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.318238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.318315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.318415] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc is going to be created. [ 818.382248] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.382868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.382868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.382868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.382868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.398574] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc in Status: IN_PROGRESS for 2s [ 818.649115] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 in Status: SUCCESS [ 818.649534] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 deletion is rescheduled due to dependency. [ 818.649534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.745030] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.745030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.745030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.745030] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d with status ACTIVE [ 818.745030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.745030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.745030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.745030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.745030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.745030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.749915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.749915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.749915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.749915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.749915] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.749915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.749915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.749915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.749915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.749915] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d is going to be updated. [ 818.773938] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.774159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.774159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.774370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.774501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.774662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a958b4c0-b125-4e05-8fd0-c3dfdf2a4b3d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.804273] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.806468] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.136198] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69eeba93-f93f-45ab-9cb2-242c52429094 in Status: SUCCESS [ 819.136485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.136674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.136896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.137185] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.137318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.137385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.137556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.137638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.137735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.137895] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69eeba93-f93f-45ab-9cb2-242c52429094',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.245512] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.307108] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.308293] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.640832] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-69eeba93-f93f-45ab-9cb2-242c52429094 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.641017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.641094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.641342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.641527] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.641642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.641791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.642091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.642215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.642385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.642542] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-69eeba93-f93f-45ab-9cb2-242c52429094 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.642695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.642769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.643354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.643354] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.643354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.644219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.644219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.644219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.644219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.644219] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69eeba93-f93f-45ab-9cb2-242c52429094',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.749506] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.749800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.749800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.750583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.750583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.750583] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be created. [ 819.780390] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.780728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.780917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.781348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.781524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.792614] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: UNINITIALIZED for 2s [ 819.811246] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.811401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.811476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.811716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.811813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.811911] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce is going to be updated. [ 819.813527] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.813656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.813754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.813981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.814114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.814212] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 819.850447] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.850641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.850736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.851257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.851472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.854571] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.854755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.854831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.855106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.855491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.869286] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: IN_PROGRESS for 2s [ 819.869981] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 820.146488] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69eeba93-f93f-45ab-9cb2-242c52429094: rpc.has_security_group_logging(os_id): False [ 820.179155] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.179155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.179155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.179155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.179155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.179155] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.179155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.179155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.179155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.179155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.179808] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.179963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.180042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.180222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.180300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.180606] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.180771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.180806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.180987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.182244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.182356] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69eeba93-f93f-45ab-9cb2-242c52429094 is going to be created. [ 820.299785] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.299785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.299785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.299785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.299785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.315480] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69eeba93-f93f-45ab-9cb2-242c52429094 in Status: IN_PROGRESS for 2s [ 820.419695] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc in Status: SUCCESS [ 820.420158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.809343] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 821.809627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.809778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.809947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.810169] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.810274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.810342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.810571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.810659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.810746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.810859] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.884585] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 821.884839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.885641] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: SUCCESS [ 821.885821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.885979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.886239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.886429] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.886576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.887110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.887289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.887379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.887471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.887648] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.887745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.887802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.887951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.888104] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.888203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.888266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.888394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.888463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.888553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.888667] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.891543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.891930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.891930] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.892055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.892595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.892743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.892857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.892955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.893075] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.313560] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.313722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.317102] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.317102] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.317102] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.317102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.318135] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.345227] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69eeba93-f93f-45ab-9cb2-242c52429094 in Status: SUCCESS [ 822.345227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.394263] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85796156-67df-4d82-b494-0ea64303f9ba: rpc.has_security_group_logging(os_id): False [ 822.395747] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.427255] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.427437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.427437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.427638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.427708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.428113] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.428113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.428113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.428406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.428406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.428473] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.429125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.429125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.429125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.429125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.429125] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.430857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.430857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.430857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.430857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.430857] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 822.528136] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.528470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.528470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.528691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.528764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.544092] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 822.751779] env[69756]: INFO networking_nsxv3.common.synchronization [req-c4161c7b-7b54-4ad8-89f1-497347f1814d req-5146dcad-1b5e-43bf-af6e-747c27d6c33b tempest-ImagesOneServerNegativeTestJSON-724061913 tempest-ImagesOneServerNegativeTestJSON-724061913-project-member] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 822.751921] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 822.752639] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.752639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.752639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.752858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.753275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.753725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.753725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.755715] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.755981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.756220] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.818211] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8feed-cd04-49d0-9fbe-c89808cf758f: rpc.has_security_group_logging(os_id): False [ 822.846856] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.847050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.847050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.847810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.847810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.847810] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.847810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.848129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.848129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.848229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.848374] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.848469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.848535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.848718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.848797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.848995] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.849586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.849675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.850770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.850770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.850770] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be created. [ 822.899506] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88b9f358-c151-4b1c-adb6-6e05b22ab1ce: rpc.has_security_group_logging(os_id): False [ 822.921294] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.921457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.921526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.921742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.921829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.922069] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.922190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.922245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.922456] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.922537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.922676] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce is going to be updated. [ 822.927845] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.927845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.927845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.927845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.927845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.949363] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 822.997010] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.997267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.997384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.997680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.997875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.011661] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: IN_PROGRESS for 2s [ 823.258996] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.259236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.259330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.261186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.261186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.261186] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.261186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.261186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.261186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.261186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.261186] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 already deleted. [ 823.261186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.804749] env[69756]: INFO networking_nsxv3.common.synchronization [None req-773c3ff0-b3f3-4746-b5c5-accb72f8328c None None] Enqueued Resource ID: 4f647352-8c5c-4ea7-9de0-14b8b1b142e3 with Priority: HIGHEST for action port [ 823.805401] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f647352-8c5c-4ea7-9de0-14b8b1b142e3 with Priority: HIGHEST for action port [ 823.805868] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f647352-8c5c-4ea7-9de0-14b8b1b142e3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.809094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f647352-8c5c-4ea7-9de0-14b8b1b142e3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.809247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f647352-8c5c-4ea7-9de0-14b8b1b142e3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.809624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f647352-8c5c-4ea7-9de0-14b8b1b142e3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.809745] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f647352-8c5c-4ea7-9de0-14b8b1b142e3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.312751] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f647352-8c5c-4ea7-9de0-14b8b1b142e3 [ 824.312751] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.312751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.312751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.312751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.312751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.312751] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f647352-8c5c-4ea7-9de0-14b8b1b142e3 already deleted. [ 824.312751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f647352-8c5c-4ea7-9de0-14b8b1b142e3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.321166] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.321304] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.321381] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.321707] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.321959] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.322150] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.322266] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.322484] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.322626] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.322826] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.322937] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.323060] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.323191] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.323280] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.323384] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.323511] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.345029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.345213] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 824.345440] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.345653] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.346959] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.346959] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.346959] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.346959] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.347307] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a82fea55-f0c7-4e9c-b0a4-9ec778a70e83',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.561391] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 824.561820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.562090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.562536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.562595] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.855527] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.856940] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.856940] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.856940] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.856940] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.856940] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port a82fea55-f0c7-4e9c-b0a4-9ec778a70e83 not found, creating... [ 824.856940] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.856940] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.857305] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.859496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.859496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.859496] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.859496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.859496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.859496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.859496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.859787] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: a82fea55-f0c7-4e9c-b0a4-9ec778a70e83 is going to be created. [ 824.862640] env[69756]: INFO networking_nsxv3.common.synchronization [req-02ba552d-9e1e-49ef-8af3-54a762647b62 req-13737129-4502-43ab-8ce4-e475ec327f05 tempest-ServerExternalEventsTest-668827054 tempest-ServerExternalEventsTest-668827054-project-member] Enqueued Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGHEST for action security_group_members [ 824.862640] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGHEST for action security_group_members [ 824.864482] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1505824-b2af-43e9-86e7-eba6fd16c230 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.864482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.864482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.864482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.864482] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.864887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.865084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.865326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.865497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.865674] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1505824-b2af-43e9-86e7-eba6fd16c230',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.886909] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.886909] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.886909] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.886909] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.886909] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.886909] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.981941] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 824.982205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.032236] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: SUCCESS [ 825.032507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.066126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.066343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.066417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.066649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.066825] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.066927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.066988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.067169] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.067256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.067353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.067432] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.158330] env[69756]: INFO networking_nsxv3.common.synchronization [req-272f5b6b-0bab-40e7-b231-70b1af4269e0 req-98dea853-1980-46ca-b784-c9e01c23a45e tempest-TenantUsagesTestJSON-348970877 tempest-TenantUsagesTestJSON-348970877-project-member] Enqueued Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGHEST for action security_group_members [ 825.158949] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGHEST for action security_group_members [ 825.159283] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-829189fa-bce1-4609-a296-4d4ca0be554d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.159418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.159492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.159811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.160060] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.160881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.160881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.160881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.160881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.160881] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('829189fa-bce1-4609-a296-4d4ca0be554d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.371791] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.371791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.372226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.372429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.372709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.373275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.373275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.373482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.374484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.375567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.375567] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1505824-b2af-43e9-86e7-eba6fd16c230 is going to be updated. [ 825.420051] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.420051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.420051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.420051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.420051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.428643] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1505824-b2af-43e9-86e7-eba6fd16c230 in Status: IN_PROGRESS for 2s [ 825.572744] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.572744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.572744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.572744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.573115] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.573115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.573115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.573313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.573365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.573502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.573608] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.573730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.573793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.573908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.574070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.574178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.574178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.574328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.574418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.574496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.574573] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.663412] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.663700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.663700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.664073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.664073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.664234] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.664301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.664359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.664549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.664635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.664811] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 829189fa-bce1-4609-a296-4d4ca0be554d already deleted. [ 825.664811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.852970] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.852970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.852970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.852970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.855283] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.855283] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.855283] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.855283] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.855283] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.855283] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.855283] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.855283] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.855283] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.855283] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.855283] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.857229] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.880204] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.880204] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.880204] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.880204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.880204] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-b5853f59-4a73-4b73-b8cf-f4367c079646 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.880204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-b5853f59-4a73-4b73-b8cf-f4367c079646" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.880204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-b5853f59-4a73-4b73-b8cf-f4367c079646" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.880204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-b5853f59-4a73-4b73-b8cf-f4367c079646" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.880204] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5853f59-4a73-4b73-b8cf-f4367c079646',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.014967] env[69756]: INFO networking_nsxv3.common.synchronization [req-c4161c7b-7b54-4ad8-89f1-497347f1814d req-da7021a5-a194-4cd2-b18c-9a448fac8799 service nova] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_rules [ 826.014967] env[69756]: INFO networking_nsxv3.common.synchronization [req-c4161c7b-7b54-4ad8-89f1-497347f1814d req-da7021a5-a194-4cd2-b18c-9a448fac8799 service nova] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 826.014967] env[69756]: INFO networking_nsxv3.common.synchronization [req-c4161c7b-7b54-4ad8-89f1-497347f1814d req-da7021a5-a194-4cd2-b18c-9a448fac8799 service nova] Enqueued Resource ID: a82fea55-f0c7-4e9c-b0a4-9ec778a70e83 with Priority: HIGHEST for action port [ 826.014967] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_rules [ 826.014967] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 826.014967] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a82fea55-f0c7-4e9c-b0a4-9ec778a70e83 with Priority: HIGHEST for action port [ 826.014967] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.016155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.016155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.016155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.016155] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.017353] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.017353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.017353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.017552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.019203] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.019203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.019203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.019203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.019203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.019203] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.022702] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.022702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.022702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.022702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.022702] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a82fea55-f0c7-4e9c-b0a4-9ec778a70e83',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.080178] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85796156-67df-4d82-b494-0ea64303f9ba: rpc.has_security_group_logging(os_id): False [ 826.102075] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.102790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.102930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.103208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.105697] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.105697] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.105697] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.106386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.106386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.106386] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 826.187383] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.187579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.187661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.187895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.188133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.227041] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 826.386335] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.386335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.386335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.386335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.386335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.386335] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port b5853f59-4a73-4b73-b8cf-f4367c079646 not found, creating... [ 826.386335] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.386335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.387189] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.387546] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.387892] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.388502] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.388502] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.388690] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.389584] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.389922] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.390129] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: b5853f59-4a73-4b73-b8cf-f4367c079646 is going to be created. [ 826.420302] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.420658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.420658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.420942] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.421296] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.421578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-b5853f59-4a73-4b73-b8cf-f4367c079646" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.526573] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.526573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.526573] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.526573] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a82fea55-f0c7-4e9c-b0a4-9ec778a70e83 with status ACTIVE [ 826.526573] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.526573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.526573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.527285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.527285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.527626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.527626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.528174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.528174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.528174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.528369] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.528936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.528936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.528936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.528936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.528936] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a82fea55-f0c7-4e9c-b0a4-9ec778a70e83 is going to be updated. [ 826.580030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.580350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.580350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.580512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.580512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.580908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a82fea55-f0c7-4e9c-b0a4-9ec778a70e83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.685677] env[69756]: INFO networking_nsxv3.common.synchronization [None req-36ef73f7-ad31-4b2f-be6d-12f7d0a8a90f None None] Enqueued Resource ID: a4947786-ffbc-4515-b7b1-fa953d79fa89 with Priority: HIGHEST for action port [ 826.685677] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4947786-ffbc-4515-b7b1-fa953d79fa89 with Priority: HIGHEST for action port [ 826.685677] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4947786-ffbc-4515-b7b1-fa953d79fa89 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.685677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4947786-ffbc-4515-b7b1-fa953d79fa89" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.685677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4947786-ffbc-4515-b7b1-fa953d79fa89" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.685677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4947786-ffbc-4515-b7b1-fa953d79fa89" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.685677] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4947786-ffbc-4515-b7b1-fa953d79fa89',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.031343] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.191151] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4947786-ffbc-4515-b7b1-fa953d79fa89 [ 827.191151] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.191151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.191151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.191151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.191151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.191151] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4947786-ffbc-4515-b7b1-fa953d79fa89 already deleted. [ 827.191151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4947786-ffbc-4515-b7b1-fa953d79fa89" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.442851] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1505824-b2af-43e9-86e7-eba6fd16c230 in Status: SUCCESS [ 827.444118] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1505824-b2af-43e9-86e7-eba6fd16c230 deletion is rescheduled due to dependency. [ 827.444118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.538493] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.538493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.538493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.538656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.538656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.538719] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be created. [ 827.574138] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.574138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.574360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.574575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.575244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.586606] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: UNINITIALIZED for 2s [ 827.604575] env[69756]: INFO networking_nsxv3.common.synchronization [None req-a3c2e3ae-781c-446c-9495-473d53241edc None None] Enqueued Resource ID: 2aa91ae5-e703-4772-84f7-9b26e5d46c0d with Priority: HIGHEST for action port [ 827.605190] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa91ae5-e703-4772-84f7-9b26e5d46c0d with Priority: HIGHEST for action port [ 827.605523] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-2aa91ae5-e703-4772-84f7-9b26e5d46c0d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.605690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2aa91ae5-e703-4772-84f7-9b26e5d46c0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.605756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2aa91ae5-e703-4772-84f7-9b26e5d46c0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.606085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2aa91ae5-e703-4772-84f7-9b26e5d46c0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.606222] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aa91ae5-e703-4772-84f7-9b26e5d46c0d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.735545] env[69756]: INFO networking_nsxv3.common.synchronization [req-272f5b6b-0bab-40e7-b231-70b1af4269e0 req-92bd3fb6-68ad-4fb9-90a3-fc434293eb4f service nova] Enqueued Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGHEST for action security_group_rules [ 827.735545] env[69756]: INFO networking_nsxv3.common.synchronization [req-272f5b6b-0bab-40e7-b231-70b1af4269e0 req-92bd3fb6-68ad-4fb9-90a3-fc434293eb4f service nova] Enqueued Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGHEST for action security_group_members [ 827.735545] env[69756]: INFO networking_nsxv3.common.synchronization [req-272f5b6b-0bab-40e7-b231-70b1af4269e0 req-92bd3fb6-68ad-4fb9-90a3-fc434293eb4f service nova] Enqueued Resource ID: b5853f59-4a73-4b73-b8cf-f4367c079646 with Priority: HIGHEST for action port [ 827.735545] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGHEST for action security_group_rules [ 827.735545] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGHEST for action security_group_members [ 827.735545] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5853f59-4a73-4b73-b8cf-f4367c079646 with Priority: HIGHEST for action port [ 827.735545] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-829189fa-bce1-4609-a296-4d4ca0be554d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.735545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.735545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.735545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.735545] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('829189fa-bce1-4609-a296-4d4ca0be554d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.737348] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-829189fa-bce1-4609-a296-4d4ca0be554d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.737560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.737667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.738011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.740344] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.740344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.740344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.740344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.740344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.740344] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('829189fa-bce1-4609-a296-4d4ca0be554d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.740886] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5853f59-4a73-4b73-b8cf-f4367c079646 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.740886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5853f59-4a73-4b73-b8cf-f4367c079646" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.740886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5853f59-4a73-4b73-b8cf-f4367c079646" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.741686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5853f59-4a73-4b73-b8cf-f4367c079646" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.741686] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5853f59-4a73-4b73-b8cf-f4367c079646',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.109768] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2aa91ae5-e703-4772-84f7-9b26e5d46c0d [ 828.110048] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.110203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.110293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.110547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.110634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.110703] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2aa91ae5-e703-4772-84f7-9b26e5d46c0d already deleted. [ 828.110851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2aa91ae5-e703-4772-84f7-9b26e5d46c0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.243557] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-829189fa-bce1-4609-a296-4d4ca0be554d taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.243911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.244247] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('829189fa-bce1-4609-a296-4d4ca0be554d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.245301] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5853f59-4a73-4b73-b8cf-f4367c079646 with status ACTIVE [ 828.246018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.246018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.246018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.246018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.246018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.252771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.252771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.252771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.253941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.253941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.253941] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.253941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.253941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.253941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.253941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.253941] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5853f59-4a73-4b73-b8cf-f4367c079646 is going to be updated. [ 828.255995] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 828.257136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.287604] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.287761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.287834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.288091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.288278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.288409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5853f59-4a73-4b73-b8cf-f4367c079646" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.756325] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('829189fa-bce1-4609-a296-4d4ca0be554d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.152746] env[69756]: INFO networking_nsxv3.common.synchronization [None req-bc2b64f8-f39c-4253-809b-b813ff88ce37 None None] Enqueued Resource ID: e4853708-07f4-4602-a616-256e9655cfe0 with Priority: HIGHEST for action port [ 829.153518] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4853708-07f4-4602-a616-256e9655cfe0 with Priority: HIGHEST for action port [ 829.153970] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4853708-07f4-4602-a616-256e9655cfe0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.154177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4853708-07f4-4602-a616-256e9655cfe0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.154227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4853708-07f4-4602-a616-256e9655cfe0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.154549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4853708-07f4-4602-a616-256e9655cfe0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.154686] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4853708-07f4-4602-a616-256e9655cfe0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.261924] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.263598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.263598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.263598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.263598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.263598] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 829189fa-bce1-4609-a296-4d4ca0be554d is going to be created. [ 829.293397] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.293600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.293651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.293857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.294066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.305768] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 829189fa-bce1-4609-a296-4d4ca0be554d in Status: UNINITIALIZED for 2s [ 829.600273] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 829.600273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.600273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.600273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.600273] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.600273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.600273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.600273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.600273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.600273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.600273] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.662587] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4853708-07f4-4602-a616-256e9655cfe0 [ 829.663807] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.663807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.663807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.663807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.663807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.663807] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4853708-07f4-4602-a616-256e9655cfe0 already deleted. [ 829.663807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4853708-07f4-4602-a616-256e9655cfe0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.989256] env[69756]: INFO networking_nsxv3.common.synchronization [None req-d83aed20-e702-428e-a550-7b55e7370ca1 tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_rules [ 829.991100] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_rules [ 829.991718] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.992057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.992238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.992641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.992928] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.102228] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.102228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.102228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.105038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.105038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.105038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.105038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.108095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.108095] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.217668] env[69756]: INFO networking_nsxv3.common.synchronization [None req-497fb64e-36b4-4379-9a2e-9eb0f1cf2b0b tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_rules [ 830.218336] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_rules [ 830.220955] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.221120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.412454] env[69756]: INFO networking_nsxv3.common.synchronization [None req-c356cdec-28b4-44b4-a1d8-fe971946f7ed None None] Enqueued Resource ID: 14f8d6de-8e53-41b9-9c85-bc52f2f08403 with Priority: HIGHEST for action port [ 830.412814] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f8d6de-8e53-41b9-9c85-bc52f2f08403 with Priority: HIGHEST for action port [ 830.413332] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-14f8d6de-8e53-41b9-9c85-bc52f2f08403 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.413499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14f8d6de-8e53-41b9-9c85-bc52f2f08403" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.413553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14f8d6de-8e53-41b9-9c85-bc52f2f08403" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.413811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14f8d6de-8e53-41b9-9c85-bc52f2f08403" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.413895] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14f8d6de-8e53-41b9-9c85-bc52f2f08403',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.514328] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.514484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.514484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.514932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.514932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.514932] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b already deleted. [ 830.514932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.515157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.516014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.516014] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.610948] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8de5d68d-6838-4955-ae71-d9dd48c0a125: rpc.has_security_group_logging(os_id): False [ 830.629288] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.629489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.629587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.629820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.629905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.630126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.630224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.630289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.630455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.630536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.630735] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.630830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.630907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.631078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.631167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.631360] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.631470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.631520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.631662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.631746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.631832] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be created. [ 830.693403] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.693560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.693628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.693837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.694029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.709843] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 830.917375] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14f8d6de-8e53-41b9-9c85-bc52f2f08403 [ 830.917619] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.917835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.917835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.918737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.919023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.919331] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14f8d6de-8e53-41b9-9c85-bc52f2f08403 already deleted. [ 830.919653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14f8d6de-8e53-41b9-9c85-bc52f2f08403" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.997547] env[69756]: INFO networking_nsxv3.common.synchronization [req-a8d2bbc8-b65a-41c5-98f7-a7500c90bc88 req-96ac538d-c76c-4e82-9b95-eb60f5ec2784 tempest-ImagesNegativeTestJSON-434328599 tempest-ImagesNegativeTestJSON-434328599-project-member] Enqueued Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGHEST for action security_group_members [ 830.998215] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGHEST for action security_group_members [ 830.998553] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-69eeba93-f93f-45ab-9cb2-242c52429094 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.998688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.998754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.998954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.999856] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.999979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.000059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.000232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.001246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.001321] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69eeba93-f93f-45ab-9cb2-242c52429094',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.039985] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.040143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.040215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.040441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.040529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.040622] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b already deleted. [ 831.040703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.317236] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 829189fa-bce1-4609-a296-4d4ca0be554d in Status: SUCCESS [ 831.317467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.317645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.317868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.318085] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.318199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.318267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.318426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.319794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.319939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.321087] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('829189fa-bce1-4609-a296-4d4ca0be554d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.506626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.506626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.506626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.506626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.506626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.506626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.506626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.506626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.506626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.506626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.506626] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69eeba93-f93f-45ab-9cb2-242c52429094 is going to be updated. [ 831.541219] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.541425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.541470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.541673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.541817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.555281] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69eeba93-f93f-45ab-9cb2-242c52429094 in Status: IN_PROGRESS for 2s [ 831.824626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-829189fa-bce1-4609-a296-4d4ca0be554d taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.825246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.826020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.826324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.826542] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.826690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.826798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.827637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.827778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.827868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.828065] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-829189fa-bce1-4609-a296-4d4ca0be554d taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.828187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.828253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.828448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.828618] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.828726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.828788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.828962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.829867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.830108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.830363] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('829189fa-bce1-4609-a296-4d4ca0be554d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.337242] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 829189fa-bce1-4609-a296-4d4ca0be554d: rpc.has_security_group_logging(os_id): False [ 832.361740] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.362923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.362923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.362923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.362923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.362923] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.362923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.362923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.362923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.362923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.363446] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.363446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.363446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.363557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.363557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.364389] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.364547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.364650] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.364820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.364911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.365019] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 829189fa-bce1-4609-a296-4d4ca0be554d is going to be created. [ 832.435412] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.435585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.435751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.435971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.436279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.450940] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 829189fa-bce1-4609-a296-4d4ca0be554d in Status: IN_PROGRESS for 2s [ 832.725045] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 832.725045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.043620] env[69756]: INFO networking_nsxv3.common.synchronization [None req-72d02166-0963-4fd9-8dfe-eff14cde5fb7 None None] Enqueued Resource ID: e162acbc-2274-4f41-8563-d74a67e6507c with Priority: HIGHEST for action port [ 833.043620] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e162acbc-2274-4f41-8563-d74a67e6507c with Priority: HIGHEST for action port [ 833.043620] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e162acbc-2274-4f41-8563-d74a67e6507c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.043620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e162acbc-2274-4f41-8563-d74a67e6507c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.047495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e162acbc-2274-4f41-8563-d74a67e6507c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.047495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e162acbc-2274-4f41-8563-d74a67e6507c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.047495] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e162acbc-2274-4f41-8563-d74a67e6507c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.558047] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e162acbc-2274-4f41-8563-d74a67e6507c [ 833.558047] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.558047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.558047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.558047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.558047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.558047] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e162acbc-2274-4f41-8563-d74a67e6507c already deleted. [ 833.558047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e162acbc-2274-4f41-8563-d74a67e6507c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.568025] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69eeba93-f93f-45ab-9cb2-242c52429094 in Status: SUCCESS [ 833.568025] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69eeba93-f93f-45ab-9cb2-242c52429094 deletion is rescheduled due to dependency. [ 833.568025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.470307] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b1d7808f-47d9-4166-b663-b37ae541069c None None] Enqueued Resource ID: c75f381c-c569-4559-8a07-8a4bef76d177 with Priority: HIGHEST for action port [ 834.472470] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 829189fa-bce1-4609-a296-4d4ca0be554d in Status: SUCCESS [ 834.472681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.473263] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75f381c-c569-4559-8a07-8a4bef76d177 with Priority: HIGHEST for action port [ 834.473682] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c75f381c-c569-4559-8a07-8a4bef76d177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.473868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c75f381c-c569-4559-8a07-8a4bef76d177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.473931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c75f381c-c569-4559-8a07-8a4bef76d177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.474317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c75f381c-c569-4559-8a07-8a4bef76d177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.474444] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c75f381c-c569-4559-8a07-8a4bef76d177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.968838] env[69756]: INFO networking_nsxv3.common.synchronization [None req-1bddc2fa-f080-42e0-b0c8-93408524bf6b None None] Enqueued Resource ID: 12b71409-0104-4422-9c2d-1e02500fd074 with Priority: HIGHEST for action port [ 834.969678] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b71409-0104-4422-9c2d-1e02500fd074 with Priority: HIGHEST for action port [ 834.972182] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-12b71409-0104-4422-9c2d-1e02500fd074 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.972182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12b71409-0104-4422-9c2d-1e02500fd074" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.972182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12b71409-0104-4422-9c2d-1e02500fd074" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.972182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12b71409-0104-4422-9c2d-1e02500fd074" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.972182] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12b71409-0104-4422-9c2d-1e02500fd074',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.980329] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c75f381c-c569-4559-8a07-8a4bef76d177 [ 834.980329] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.980329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.980329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.980329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.980329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.980329] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c75f381c-c569-4559-8a07-8a4bef76d177 already deleted. [ 834.980329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c75f381c-c569-4559-8a07-8a4bef76d177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.480136] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12b71409-0104-4422-9c2d-1e02500fd074 [ 835.480136] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.480136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.480136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.480136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.480136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.480136] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12b71409-0104-4422-9c2d-1e02500fd074 already deleted. [ 835.480136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12b71409-0104-4422-9c2d-1e02500fd074" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.021139] env[69756]: INFO networking_nsxv3.common.synchronization [None req-a827871c-46ba-49db-81d9-7b07dc4b49e1 None None] Enqueued Resource ID: ef53ff49-a428-4050-9d79-f36ab38bdb49 with Priority: HIGHEST for action port [ 837.022035] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef53ff49-a428-4050-9d79-f36ab38bdb49 with Priority: HIGHEST for action port [ 837.022964] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef53ff49-a428-4050-9d79-f36ab38bdb49 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.023141] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef53ff49-a428-4050-9d79-f36ab38bdb49" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.023214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef53ff49-a428-4050-9d79-f36ab38bdb49" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.023483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef53ff49-a428-4050-9d79-f36ab38bdb49" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.023577] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef53ff49-a428-4050-9d79-f36ab38bdb49',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.402884] env[69756]: INFO networking_nsxv3.common.synchronization [None req-0b498336-f9be-4f51-a65d-6a49baf457f8 tempest-ServersTestManualDisk-175454458 tempest-ServersTestManualDisk-175454458-project-member] Enqueued Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_rules [ 837.403504] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_rules [ 837.403886] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6688165-9289-4b4f-a688-1379d300b9cd taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.403983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.404049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.404345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.404473] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.452117] env[69756]: INFO networking_nsxv3.common.synchronization [None req-82f877eb-6f9d-403d-bb33-39c9644cc90b None None] Enqueued Resource ID: 8060571d-420e-4c3b-bccf-e66463d95efe with Priority: HIGHEST for action port [ 837.452510] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8060571d-420e-4c3b-bccf-e66463d95efe with Priority: HIGHEST for action port [ 837.452812] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-8060571d-420e-4c3b-bccf-e66463d95efe taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.452934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8060571d-420e-4c3b-bccf-e66463d95efe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.452996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8060571d-420e-4c3b-bccf-e66463d95efe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.453268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8060571d-420e-4c3b-bccf-e66463d95efe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.453582] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8060571d-420e-4c3b-bccf-e66463d95efe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.528587] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef53ff49-a428-4050-9d79-f36ab38bdb49 [ 837.528587] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.528587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.528587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.528587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.528587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.528587] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef53ff49-a428-4050-9d79-f36ab38bdb49 already deleted. [ 837.528587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef53ff49-a428-4050-9d79-f36ab38bdb49" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.569178] env[69756]: INFO networking_nsxv3.common.synchronization [None req-fdb877e4-d8a1-48af-8286-04ce7f11bd2e tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_rules [ 837.569852] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_rules [ 837.569852] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5f631a6-10e1-4423-9d64-92e1be795a21 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.570013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.570013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.571692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.571783] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.631170] env[69756]: INFO networking_nsxv3.common.synchronization [None req-63965595-5d86-4db1-8514-cd4dce8f690d tempest-ServersTestManualDisk-175454458 tempest-ServersTestManualDisk-175454458-project-member] Enqueued Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_rules [ 837.632192] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_rules [ 837.635033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6688165-9289-4b4f-a688-1379d300b9cd taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.635033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.781683] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b7508f9f-3b3c-40a3-aaa2-53bd4707851a tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_rules [ 837.781683] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_rules [ 837.781683] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5f631a6-10e1-4423-9d64-92e1be795a21 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.781683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.939199] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.939199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.939199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.939199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.939199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.940719] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6688165-9289-4b4f-a688-1379d300b9cd already deleted. [ 837.940719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.940719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.940719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.940719] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.956348] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8060571d-420e-4c3b-bccf-e66463d95efe [ 837.956605] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.956745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.956816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.957053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.957144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.957244] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8060571d-420e-4c3b-bccf-e66463d95efe already deleted. [ 837.957345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8060571d-420e-4c3b-bccf-e66463d95efe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.098424] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.099400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.099400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.099400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.099400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.099400] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5f631a6-10e1-4423-9d64-92e1be795a21 already deleted. [ 838.099400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.100412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.100412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.100412] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.459448] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.460657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.460657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.460657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.460657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.460657] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6688165-9289-4b4f-a688-1379d300b9cd already deleted. [ 838.460657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.626287] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.626468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.626542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.627021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.627021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.627021] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5f631a6-10e1-4423-9d64-92e1be795a21 already deleted. [ 838.627182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.030207] env[69756]: INFO networking_nsxv3.common.synchronization [None req-ab686972-bf18-42c6-95b3-478f592fd52d None None] Enqueued Resource ID: 1e030afc-fcb1-4131-8486-46341976d09d with Priority: HIGHEST for action port [ 840.030207] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e030afc-fcb1-4131-8486-46341976d09d with Priority: HIGHEST for action port [ 840.030207] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e030afc-fcb1-4131-8486-46341976d09d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.030207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e030afc-fcb1-4131-8486-46341976d09d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.030207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e030afc-fcb1-4131-8486-46341976d09d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.033701] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e030afc-fcb1-4131-8486-46341976d09d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.034572] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e030afc-fcb1-4131-8486-46341976d09d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.101492] env[69756]: INFO networking_nsxv3.common.synchronization [req-c620c557-56e2-4e1b-a73b-4f3e122a16f7 req-9da7d5e4-f58d-42f4-b0db-08c558ef5bb1 tempest-DeleteServersAdminTestJSON-1550782210 tempest-DeleteServersAdminTestJSON-1550782210-project-member] Enqueued Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 840.103850] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 840.104522] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.104522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.104522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.104522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.104915] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.104915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.104915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.105205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.105205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.105205] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.536987] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e030afc-fcb1-4131-8486-46341976d09d [ 840.536987] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.536987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.537161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.537278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.537370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.537467] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e030afc-fcb1-4131-8486-46341976d09d already deleted. [ 840.537553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e030afc-fcb1-4131-8486-46341976d09d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.545863] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.550801] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.550801] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.551308] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.551711] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.552100] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.552100] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.552349] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.552508] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.552742] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 840.552870] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.552987] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.553127] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.553262] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 840.553375] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.553560] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.561098] env[69756]: INFO networking_nsxv3.common.synchronization [req-568d637b-fc44-4374-97af-d69ac5b6dd86 req-14bdccbf-fcd7-4690-89d3-89dc5bc842b4 tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 840.561098] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 840.563224] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.563224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.563224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.563224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.563224] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.563224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.563224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.563224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.563224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.563224] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.580069] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.580251] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 840.580389] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.580562] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.580873] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-3ca934cf-39ec-4a01-bd2b-3cac852230be taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.581055] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-3ca934cf-39ec-4a01-bd2b-3cac852230be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.581174] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-3ca934cf-39ec-4a01-bd2b-3cac852230be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.581519] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-3ca934cf-39ec-4a01-bd2b-3cac852230be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.581659] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ca934cf-39ec-4a01-bd2b-3cac852230be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.606793] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.606938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.607037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.607364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.607450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.607614] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.607730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.607856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.607972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.608076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.608076] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bf1989-7e31-4042-8158-612d65438abc is going to be updated. [ 840.639566] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.639850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.639948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.640585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.640585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.652651] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: IN_PROGRESS for 2s [ 840.868742] env[69756]: INFO networking_nsxv3.common.synchronization [req-568d637b-fc44-4374-97af-d69ac5b6dd86 req-14bdccbf-fcd7-4690-89d3-89dc5bc842b4 tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 840.868920] env[69756]: INFO networking_nsxv3.common.synchronization [req-568d637b-fc44-4374-97af-d69ac5b6dd86 req-14bdccbf-fcd7-4690-89d3-89dc5bc842b4 tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 840.869073] env[69756]: INFO networking_nsxv3.common.synchronization [req-568d637b-fc44-4374-97af-d69ac5b6dd86 req-14bdccbf-fcd7-4690-89d3-89dc5bc842b4 tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 with Priority: HIGHEST for action port [ 840.869730] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 840.870059] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 840.870059] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 with Priority: HIGHEST for action port [ 840.871025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.871156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.871237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.871432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.871514] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.872357] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.872469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.872640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-037cdecf-d2c1-4cc4-b247-845cc278dc58 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.872739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.872801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.872976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.873067] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('037cdecf-d2c1-4cc4-b247-845cc278dc58',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.066217] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.088578] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.088578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.088578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.088578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.088578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.088578] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 3ca934cf-39ec-4a01-bd2b-3cac852230be not found, creating... [ 841.088578] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.088578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.088578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.088578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.088578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.089023] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.089023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.089023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.089023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.089023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.089023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 3ca934cf-39ec-4a01-bd2b-3cac852230be is going to be created. [ 841.112484] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.115019] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.115019] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.115019] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.115019] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.116354] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-3ca934cf-39ec-4a01-bd2b-3cac852230be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.375360] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.375946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.376974] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 037cdecf-d2c1-4cc4-b247-845cc278dc58 with status ACTIVE [ 841.377195] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.377322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.377468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.377713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.377871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.377996] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.378152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.378152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.379680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.379680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.379680] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.379680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.379680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.379680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.379680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.379680] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 is going to be updated. [ 841.407979] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.407979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.407979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.407979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.407979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.407979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.569035] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.945324] env[69756]: INFO networking_nsxv3.common.synchronization [req-c620c557-56e2-4e1b-a73b-4f3e122a16f7 req-7d88c3a7-f7d8-4556-99d1-cb69b00f683e service nova] Enqueued Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_rules [ 841.945524] env[69756]: INFO networking_nsxv3.common.synchronization [req-c620c557-56e2-4e1b-a73b-4f3e122a16f7 req-7d88c3a7-f7d8-4556-99d1-cb69b00f683e service nova] Enqueued Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 841.945673] env[69756]: INFO networking_nsxv3.common.synchronization [req-c620c557-56e2-4e1b-a73b-4f3e122a16f7 req-7d88c3a7-f7d8-4556-99d1-cb69b00f683e service nova] Enqueued Resource ID: 3ca934cf-39ec-4a01-bd2b-3cac852230be with Priority: HIGHEST for action port [ 841.946234] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_rules [ 841.946234] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 841.946234] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca934cf-39ec-4a01-bd2b-3cac852230be with Priority: HIGHEST for action port [ 841.946786] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.947021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.947112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.947338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.947433] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.948442] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.948500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.948743] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ca934cf-39ec-4a01-bd2b-3cac852230be taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.948861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ca934cf-39ec-4a01-bd2b-3cac852230be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.948926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ca934cf-39ec-4a01-bd2b-3cac852230be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.949121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ca934cf-39ec-4a01-bd2b-3cac852230be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.949199] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ca934cf-39ec-4a01-bd2b-3cac852230be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.073560] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.073560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.073560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.073560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.073560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.073560] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 is going to be updated. [ 842.113492] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.113492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.113492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.113492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.113492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.122866] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: IN_PROGRESS for 2s [ 842.452086] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.456102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.457095] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ca934cf-39ec-4a01-bd2b-3cac852230be with status ACTIVE [ 842.457585] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.458239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.458611] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.459383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.460019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.462019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.462019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.462019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.462019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.462019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.462019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.462019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.462019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.462019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.462019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.462601] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ca934cf-39ec-4a01-bd2b-3cac852230be is going to be updated. [ 842.490562] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.490562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.490562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.490562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.490562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.490562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ca934cf-39ec-4a01-bd2b-3cac852230be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.667208] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: SUCCESS [ 842.667208] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bf1989-7e31-4042-8158-612d65438abc deletion is rescheduled due to dependency. [ 842.667208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.667208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.667208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.667208] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.667208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.667208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.667208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.667208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.667208] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.877163] env[69756]: INFO networking_nsxv3.common.synchronization [req-dc0aad72-3ace-408e-b296-41225e65b297 req-7c61464d-9138-4c8f-84fd-8aaa4b5f5dcb tempest-ServersNegativeTestJSON-1110560868 tempest-ServersNegativeTestJSON-1110560868-project-member] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 842.877163] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 842.877627] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.877765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.877813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.878484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.878825] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.879024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.879158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.879454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.879782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.879782] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.884452] env[69756]: INFO networking_nsxv3.common.synchronization [None req-6bd3c87b-dccb-42cd-b6bf-d7452cda22cc None None] Enqueued Resource ID: 2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0 with Priority: HIGHEST for action port [ 842.884452] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0 with Priority: HIGHEST for action port [ 842.884790] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.884867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.884948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.885306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.885442] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.170263] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.384915] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.385134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.385249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.385553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.385780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.385919] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.386072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.386164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.388287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.388287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.388287] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 already deleted. [ 843.388287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.388287] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0 [ 843.388660] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.388845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.388994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.389256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.389429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.389608] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0 already deleted. [ 843.389762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bf29e07-1ad8-4a0c-a108-ab76f86eb2c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.502261] env[69756]: INFO networking_nsxv3.common.synchronization [None req-17497acc-443b-4715-a783-2622e07a22f4 None None] Enqueued Resource ID: 96ee6a0a-810e-43f3-84e5-560817a71ec7 with Priority: HIGHEST for action port [ 843.502765] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96ee6a0a-810e-43f3-84e5-560817a71ec7 with Priority: HIGHEST for action port [ 843.503774] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-96ee6a0a-810e-43f3-84e5-560817a71ec7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.503993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96ee6a0a-810e-43f3-84e5-560817a71ec7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.504077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96ee6a0a-810e-43f3-84e5-560817a71ec7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.504849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96ee6a0a-810e-43f3-84e5-560817a71ec7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.504849] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96ee6a0a-810e-43f3-84e5-560817a71ec7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.672873] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.697787] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-625 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.698100] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.698100] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.698478] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.699041] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.699041] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.699041] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.699844] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.699844] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.699844] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.699988] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.700080] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.700951] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.700951] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.700951] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.700951] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.722064] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.722259] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.722407] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.722585] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.722996] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.723239] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.723454] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.723768] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.724099] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.006794] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96ee6a0a-810e-43f3-84e5-560817a71ec7 [ 844.007105] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.007313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.007827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.007827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.007969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.008022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96ee6a0a-810e-43f3-84e5-560817a71ec7 already deleted. [ 844.008161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96ee6a0a-810e-43f3-84e5-560817a71ec7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.073075] env[69756]: INFO networking_nsxv3.common.synchronization [req-121fffb6-8e03-4562-a072-92dff2991840 req-1fe584e0-f2f7-4753-881a-882a5a296a1b tempest-TenantUsagesTestJSON-348970877 tempest-TenantUsagesTestJSON-348970877-project-member] Enqueued Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGHEST for action security_group_members [ 844.073075] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGHEST for action security_group_members [ 844.073075] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-829189fa-bce1-4609-a296-4d4ca0be554d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.073075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.073840] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.074217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.075107] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.075368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.075521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.075814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.076035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.076271] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('829189fa-bce1-4609-a296-4d4ca0be554d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.138251] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: SUCCESS [ 844.138251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.138251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.138251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.138251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.138251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.138251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.138251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.138251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.138251] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.177702] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.178029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.178029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.178124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.179049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.179049] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bf1989-7e31-4042-8158-612d65438abc is going to be updated. [ 844.209185] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.209385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.209385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.209590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.209726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.223711] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: IN_PROGRESS for 2s [ 844.229143] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.229143] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.229143] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.229143] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.229143] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.229143] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 not found, creating... [ 844.229143] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.229143] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.229143] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.229143] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.229143] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.229569] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.229569] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.229569] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.229696] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.230241] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.230241] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 is going to be created. [ 844.255831] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.255831] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.255831] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.256155] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.256232] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.256471] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.578505] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.578761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.578883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.579121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.579258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.579504] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.579642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.579734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.579925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.580068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.580165] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 829189fa-bce1-4609-a296-4d4ca0be554d is going to be updated. [ 844.608836] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.609114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.609114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.609292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.609469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.624978] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 829189fa-bce1-4609-a296-4d4ca0be554d in Status: IN_PROGRESS for 2s [ 844.642028] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.075850] env[69756]: INFO networking_nsxv3.common.synchronization [req-dc0aad72-3ace-408e-b296-41225e65b297 req-c223f7ef-3a40-4b02-bd5d-0d9c8bb19059 service nova] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_rules [ 845.076076] env[69756]: INFO networking_nsxv3.common.synchronization [req-dc0aad72-3ace-408e-b296-41225e65b297 req-c223f7ef-3a40-4b02-bd5d-0d9c8bb19059 service nova] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 845.076210] env[69756]: INFO networking_nsxv3.common.synchronization [req-dc0aad72-3ace-408e-b296-41225e65b297 req-c223f7ef-3a40-4b02-bd5d-0d9c8bb19059 service nova] Enqueued Resource ID: c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 with Priority: HIGHEST for action port [ 845.076797] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_rules [ 845.076897] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 845.077013] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 with Priority: HIGHEST for action port [ 845.078734] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.078989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.078989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.079308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.079411] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.080334] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.080453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.080517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.080706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.080849] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.080944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.081112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.081172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.081246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.081336] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.083769] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.083769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.083927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.083991] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.084064] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.148778] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.586292] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.587415] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.588192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.588192] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 with status ACTIVE [ 845.588192] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.588192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.588192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.588192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.588436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.588436] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.588514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.588548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.588700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.588784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.588941] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.589042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.589103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.589248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.589319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.589402] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 is going to be updated. [ 845.610497] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.611100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.611100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.611100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.611100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.611378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.653119] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.653119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.653119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.653119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.653119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.653119] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 is going to be updated. [ 845.686850] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.686850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.686850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.686850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.686850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.695428] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: IN_PROGRESS for 2s [ 845.815120] env[69756]: INFO networking_nsxv3.common.synchronization [req-e48bf7ea-c7ef-47f2-a64f-16add2fcf60c req-71e469a2-377f-49bf-84fa-e655dc5c60ac tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 845.816649] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 845.816649] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.816649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.838470] env[69756]: INFO networking_nsxv3.common.synchronization [req-e48bf7ea-c7ef-47f2-a64f-16add2fcf60c req-71e469a2-377f-49bf-84fa-e655dc5c60ac tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 845.838470] env[69756]: INFO networking_nsxv3.common.synchronization [req-e48bf7ea-c7ef-47f2-a64f-16add2fcf60c req-71e469a2-377f-49bf-84fa-e655dc5c60ac tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 845.838470] env[69756]: INFO networking_nsxv3.common.synchronization [req-e48bf7ea-c7ef-47f2-a64f-16add2fcf60c req-71e469a2-377f-49bf-84fa-e655dc5c60ac tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 with Priority: HIGHEST for action port [ 845.838470] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_rules [ 845.838470] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 845.838470] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 with Priority: HIGHEST for action port [ 845.838794] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.839084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.839388] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.839587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.839857] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-037cdecf-d2c1-4cc4-b247-845cc278dc58 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.840097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.841436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.841436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.841436] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('037cdecf-d2c1-4cc4-b247-845cc278dc58',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.005490] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e985ede1-9aaa-478f-a408-240ec4df2502 None None] Enqueued Resource ID: b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32 with Priority: HIGHEST for action port [ 846.006223] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32 with Priority: HIGHEST for action port [ 846.006608] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.006778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.006873] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.008382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.008472] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.092316] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.235266] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: SUCCESS [ 846.235506] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.235729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.235951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.236164] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.236289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.236351] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.236582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.236677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.236769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.236862] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.347462] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 037cdecf-d2c1-4cc4-b247-845cc278dc58 with status ACTIVE [ 846.347882] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.348150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.348259] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.348838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.350831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.351197] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.351322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.351393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.351602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.351691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.351894] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.352019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.352062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.352315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.352315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.352417] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 037cdecf-d2c1-4cc4-b247-845cc278dc58 is going to be updated. [ 846.376895] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.377120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.377120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.378021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.378021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.378021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-037cdecf-d2c1-4cc4-b247-845cc278dc58" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.511529] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32 [ 846.512226] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.512437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.512546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.512824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.512939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.513091] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32 already deleted. [ 846.513868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4b8faf3-70b7-4bf8-aa18-1d269ccf7f32" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.596803] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.600342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.600342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.600342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.600342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.600342] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be created. [ 846.632182] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.632757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.633058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.633521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.633918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.637170] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 829189fa-bce1-4609-a296-4d4ca0be554d in Status: SUCCESS [ 846.637758] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 829189fa-bce1-4609-a296-4d4ca0be554d deletion is rescheduled due to dependency. [ 846.638133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.649292] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: UNINITIALIZED for 2s [ 846.741570] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.741725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.741804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.742036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.742211] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.742316] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.742385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.742549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.742640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.742729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.742877] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.742970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.743043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.743194] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.743330] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.743420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.743494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.744145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.744145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.744145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.744145] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.895767] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f9efd29-c89f-4a04-a9bb-8f08c8a2b3b4 req-f926248c-c734-4087-801b-d1dd4cabc894 tempest-ServerActionsV293TestJSON-543463791 tempest-ServerActionsV293TestJSON-543463791-project-member] Enqueued Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_members [ 846.896828] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_members [ 846.896828] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.897120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.897120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.897924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.897924] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.897924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.897924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.897924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.898223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.898223] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.247250] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3bf1989-7e31-4042-8158-612d65438abc: rpc.has_security_group_logging(os_id): False [ 847.283192] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.283192] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.283192] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.283192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.284020] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.284020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.285160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.285160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.285160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.285160] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3bf1989-7e31-4042-8158-612d65438abc is going to be updated. [ 847.365515] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.365515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.365515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.365922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.366111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.387827] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: IN_PROGRESS for 2s [ 847.401516] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.402496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.402496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.402496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.402496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.402496] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.402496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.402496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.403217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.403217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.403217] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 already deleted. [ 847.403217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.422131] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.422232] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-794" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.422412] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-794" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.422649] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-794" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.422925] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.423139] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.423265] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.423507] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.423654] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.423935] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.424070] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.424181] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.424291] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.424416] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.424545] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.424681] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.449424] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.449664] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 847.449833] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.450064] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-794" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.450405] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-4f69cd39-f58f-45bc-835c-5827d60aca68 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.450584] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-4f69cd39-f58f-45bc-835c-5827d60aca68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.450703] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-4f69cd39-f58f-45bc-835c-5827d60aca68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.451079] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-4f69cd39-f58f-45bc-835c-5827d60aca68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.452026] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f69cd39-f58f-45bc-835c-5827d60aca68',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.712321] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: SUCCESS [ 847.712644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.712832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.713235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.713521] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.713589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.713628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.715030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.715030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.715030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.715030] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.715316] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.715394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.715560] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.715660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.715728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.715901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.715982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.716104] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.954862] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.955094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.955221] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.955555] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.955733] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.955910] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 4f69cd39-f58f-45bc-835c-5827d60aca68 not found, creating... [ 847.956198] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.956362] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.957144] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.957144] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.957144] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.957312] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.957442] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.957883] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.957883] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.957975] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.958544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 4f69cd39-f58f-45bc-835c-5827d60aca68 is going to be created. [ 847.988447] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.988660] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.988870] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.989079] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.989316] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.989550] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-4f69cd39-f58f-45bc-835c-5827d60aca68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.217605] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.219158] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.662901] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: SUCCESS [ 848.663301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.663421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.663719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.663962] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.664124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.664192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.664390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.664486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.664574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.664703] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.720058] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cae8dc5-dcca-4592-aebe-26bb46462d80: rpc.has_security_group_logging(os_id): False [ 848.721651] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.745254] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.745485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.745540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.745856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.746077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.746439] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.746729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.746729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.746875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.747115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.747379] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 is going to be updated. [ 848.811232] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.811498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.811571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.811808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.812027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.832048] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: IN_PROGRESS for 2s [ 848.896376] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f9efd29-c89f-4a04-a9bb-8f08c8a2b3b4 req-9c8e0a04-b069-4802-863f-72421d5b8735 service nova] Enqueued Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_rules [ 848.896563] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f9efd29-c89f-4a04-a9bb-8f08c8a2b3b4 req-9c8e0a04-b069-4802-863f-72421d5b8735 service nova] Enqueued Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_members [ 848.896733] env[69756]: INFO networking_nsxv3.common.synchronization [req-1f9efd29-c89f-4a04-a9bb-8f08c8a2b3b4 req-9c8e0a04-b069-4802-863f-72421d5b8735 service nova] Enqueued Resource ID: 4f69cd39-f58f-45bc-835c-5827d60aca68 with Priority: HIGHEST for action port [ 848.897354] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_rules [ 848.897354] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_members [ 848.897604] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f69cd39-f58f-45bc-835c-5827d60aca68 with Priority: HIGHEST for action port [ 848.897688] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.897845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.898529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.899891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.899891] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.904953] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.904953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.904953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.904953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.904953] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.904953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.904953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.904953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.904953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.904953] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.904953] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f69cd39-f58f-45bc-835c-5827d60aca68 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.908883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f69cd39-f58f-45bc-835c-5827d60aca68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.908883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f69cd39-f58f-45bc-835c-5827d60aca68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.908883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f69cd39-f58f-45bc-835c-5827d60aca68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.908883] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f69cd39-f58f-45bc-835c-5827d60aca68',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.175129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.175129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.175129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.175129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.175129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.175864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.175864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.175864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.175864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.175864] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.229377] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.229377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.229377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.229377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.229377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.229377] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 is going to be updated. [ 849.265854] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.266187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.266390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.266738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.268047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.277958] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: IN_PROGRESS for 2s [ 849.403517] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: SUCCESS [ 849.403517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.408840] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.408840] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.408840] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.411650] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f69cd39-f58f-45bc-835c-5827d60aca68 with status ACTIVE [ 849.412011] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.412294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.412487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.412834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.413098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.415725] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.415725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.415725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.415725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.415725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.415725] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.415725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.415725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.415725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.415725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.415725] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f69cd39-f58f-45bc-835c-5827d60aca68 is going to be updated. [ 849.438829] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.438829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.438829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.438829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.438829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.438829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f69cd39-f58f-45bc-835c-5827d60aca68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.679496] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 285c5000-ac60-42b0-8441-f857f98438d0: rpc.has_security_group_logging(os_id): False [ 849.707346] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.707541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.707587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.707817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.707998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.708309] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.708482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.708582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.708890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.709480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.709648] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.709891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.710091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.710437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.710665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.711070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.712397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.712547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.712786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.712944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.713329] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be created. [ 849.777460] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.777846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.777846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.777990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.778247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.792119] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: IN_PROGRESS for 2s [ 849.914459] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.417684] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.417684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.417684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.417684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.417684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.417684] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 is going to be created. [ 850.483406] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.483406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.483624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.483684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.483797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.498224] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 in Status: UNINITIALIZED for 2s [ 850.592541] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b23f2c9d-cb14-4f3f-8e46-b580f1710f81 None None] Enqueued Resource ID: 584975a2-a584-4631-a7a0-0b4d5883316f with Priority: HIGHEST for action port [ 850.592779] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584975a2-a584-4631-a7a0-0b4d5883316f with Priority: HIGHEST for action port [ 850.593124] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-584975a2-a584-4631-a7a0-0b4d5883316f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.593242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-584975a2-a584-4631-a7a0-0b4d5883316f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.593341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-584975a2-a584-4631-a7a0-0b4d5883316f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.593569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-584975a2-a584-4631-a7a0-0b4d5883316f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.593647] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('584975a2-a584-4631-a7a0-0b4d5883316f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.851146] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: SUCCESS [ 850.851598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.851598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.851933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.851933] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.944104] env[69756]: INFO networking_nsxv3.common.synchronization [None req-195f71b0-e13f-43c1-8456-e27d3b0d16df None None] Enqueued Resource ID: cc1c5794-31ca-4d35-9c48-17c6aa50117c with Priority: HIGHEST for action port [ 850.948207] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1c5794-31ca-4d35-9c48-17c6aa50117c with Priority: HIGHEST for action port [ 850.948207] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc1c5794-31ca-4d35-9c48-17c6aa50117c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.948207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc1c5794-31ca-4d35-9c48-17c6aa50117c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.948207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc1c5794-31ca-4d35-9c48-17c6aa50117c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.948207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc1c5794-31ca-4d35-9c48-17c6aa50117c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.948207] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc1c5794-31ca-4d35-9c48-17c6aa50117c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.096734] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 584975a2-a584-4631-a7a0-0b4d5883316f [ 851.097012] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.097152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.097217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.097445] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.097576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.097682] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:584975a2-a584-4631-a7a0-0b4d5883316f already deleted. [ 851.097769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-584975a2-a584-4631-a7a0-0b4d5883316f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.190934] env[69756]: INFO networking_nsxv3.common.synchronization [req-ab03a5af-cc7d-4f18-b957-300e205659a5 req-e31119b4-daca-424b-b5db-bc5cfedd0485 tempest-AttachInterfacesUnderV243Test-1409176205 tempest-AttachInterfacesUnderV243Test-1409176205-project-member] Enqueued Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 851.191499] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 with Priority: HIGHEST for action security_group_members [ 851.191846] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.192966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.296895] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: SUCCESS [ 851.296895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.296895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.296895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.296895] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.296895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.296895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.296895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.296895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.296895] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.356254] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cae8dc5-dcca-4592-aebe-26bb46462d80 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.356395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.449915] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc1c5794-31ca-4d35-9c48-17c6aa50117c [ 851.450190] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.450412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.450412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.451347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.452150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.452289] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc1c5794-31ca-4d35-9c48-17c6aa50117c already deleted. [ 851.452426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc1c5794-31ca-4d35-9c48-17c6aa50117c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.800928] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.801099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.801187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.801412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.801502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.801722] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.801835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.801881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.802045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.802133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.802221] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 is going to be updated. [ 851.811511] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: SUCCESS [ 851.811511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.833180] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.833462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.834092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.834092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.834092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.844857] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: IN_PROGRESS for 2s [ 852.513477] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 in Status: SUCCESS [ 852.513477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.513477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.513477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.513477] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.513477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.513477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.513477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.513982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.513982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.513982] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.936035] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e142481f-fbe2-4f78-8e39-45bd3d5235da None None] Enqueued Resource ID: b25adb67-64cf-4fb0-8def-ca12c0532b2e with Priority: HIGHEST for action port [ 852.936035] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b25adb67-64cf-4fb0-8def-ca12c0532b2e with Priority: HIGHEST for action port [ 852.936035] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b25adb67-64cf-4fb0-8def-ca12c0532b2e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.936035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b25adb67-64cf-4fb0-8def-ca12c0532b2e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.936035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b25adb67-64cf-4fb0-8def-ca12c0532b2e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.936035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b25adb67-64cf-4fb0-8def-ca12c0532b2e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.936035] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25adb67-64cf-4fb0-8def-ca12c0532b2e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.010726] env[69756]: INFO networking_nsxv3.common.synchronization [None req-96c2cca5-5f23-4b04-a003-b8629e26180f tempest-ServersTestJSON-1985496736 tempest-ServersTestJSON-1985496736-project-member] Enqueued Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_rules [ 853.011195] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_rules [ 853.011497] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.011660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.011724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.011942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.013437] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.018115] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.039868] env[69756]: INFO networking_nsxv3.common.synchronization [req-96b6accb-05a5-4cef-bfff-e5582630045f req-e47e2ca8-72ba-4742-9711-f200906c4dc6 tempest-ServersTestBootFromVolume-553600348 tempest-ServersTestBootFromVolume-553600348-project-member] Enqueued Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_members [ 853.040591] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_members [ 853.040939] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa5dd68d-835d-4416-ac9f-cab1591b2b82 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.041084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.041153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.041402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.041556] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.041664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.041726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.041875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.041959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.042061] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.158867] env[69756]: INFO networking_nsxv3.common.synchronization [None req-6cd2e1c7-9215-4d3b-9f77-ac9d4e68546b tempest-ServersTestJSON-1985496736 tempest-ServersTestJSON-1985496736-project-member] Enqueued Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_rules [ 853.159504] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_rules [ 853.160146] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.160146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.194696] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8645040b-2e11-489e-aec2-faa3c5da0772 None None] Enqueued Resource ID: b23380f0-1e86-476d-a3c2-8084258f76bf with Priority: HIGHEST for action port [ 853.195371] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b23380f0-1e86-476d-a3c2-8084258f76bf with Priority: HIGHEST for action port [ 853.195956] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b23380f0-1e86-476d-a3c2-8084258f76bf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.196595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b23380f0-1e86-476d-a3c2-8084258f76bf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.196595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b23380f0-1e86-476d-a3c2-8084258f76bf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.196595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b23380f0-1e86-476d-a3c2-8084258f76bf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.197385] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b23380f0-1e86-476d-a3c2-8084258f76bf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.441083] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b25adb67-64cf-4fb0-8def-ca12c0532b2e [ 853.441304] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.441695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.441695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.441844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.441844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.441924] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b25adb67-64cf-4fb0-8def-ca12c0532b2e already deleted. [ 853.441984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b25adb67-64cf-4fb0-8def-ca12c0532b2e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.523167] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85a485c2-7c41-4a10-ae35-986ad49897e2: rpc.has_security_group_logging(os_id): False [ 853.537766] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.537766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.537766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.537766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.538079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.538079] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a already deleted. [ 853.538079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.538211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.538463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.538586] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.546405] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.546713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.546713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.546862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.546960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.548868] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.548868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.548868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.548868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.548868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.548868] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 is going to be created. [ 853.549588] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.549588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.549680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.549813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.549910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.550114] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.550215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.550295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.550383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.550488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.550552] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 already deleted. [ 853.550630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.613920] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.614100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.614415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.614415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.616063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.627129] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 in Status: IN_PROGRESS for 2s [ 853.703437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b23380f0-1e86-476d-a3c2-8084258f76bf [ 853.703684] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.703822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.703902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.704152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.706020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.706020] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b23380f0-1e86-476d-a3c2-8084258f76bf already deleted. [ 853.706020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b23380f0-1e86-476d-a3c2-8084258f76bf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.820731] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.820731] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-997" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.820731] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-997" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.820907] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-997" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.821150] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.821465] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.822767] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.822851] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.825687] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.825687] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.825687] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.825687] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.825687] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.825687] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.825687] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.825687] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.845094] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.845265] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.845406] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.845609] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-997" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.845927] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-f67de4f5-bb24-406d-9f4b-c39176e1501e taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.846146] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-f67de4f5-bb24-406d-9f4b-c39176e1501e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.846279] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-f67de4f5-bb24-406d-9f4b-c39176e1501e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.846628] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-f67de4f5-bb24-406d-9f4b-c39176e1501e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.846767] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f67de4f5-bb24-406d-9f4b-c39176e1501e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.859645] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: SUCCESS [ 853.859645] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 deletion is rescheduled due to dependency. [ 853.859745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.859961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.860188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.861547] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.862511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.862557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.862734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.862867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.863027] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.067823] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.068043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.068128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.068402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.069349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.069349] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a already deleted. [ 854.069349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.178483] env[69756]: INFO networking_nsxv3.common.synchronization [req-75ea8007-f84e-4561-8175-80f894eb108c req-6f1f7f55-3a43-4a41-bde9-52be0c16bb16 tempest-ImagesOneServerNegativeTestJSON-724061913 tempest-ImagesOneServerNegativeTestJSON-724061913-project-member] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 854.178830] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 854.179163] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.179259] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.179326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.179531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.179684] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.179786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.179848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.179992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.181336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.181336] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.352026] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.352286] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.355072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.355072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.355072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.355072] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port f67de4f5-bb24-406d-9f4b-c39176e1501e not found, creating... [ 854.355072] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.355072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.355072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.355072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.355072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.355072] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.355382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.355382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.355382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.355382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.355382] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: f67de4f5-bb24-406d-9f4b-c39176e1501e is going to be created. [ 854.365543] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.365832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.365945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.366186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.366375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.366551] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.366731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.366937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.367191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.367308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.367434] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 is going to be updated. [ 854.377985] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.378213] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.378339] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.378608] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.378855] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.379132] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-f67de4f5-bb24-406d-9f4b-c39176e1501e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.393755] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.393918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.393990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.394239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.394464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.408628] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: IN_PROGRESS for 2s [ 854.682637] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.682953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.682953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.683153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.683253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.683468] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.683591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.683660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.683907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.684048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.684048] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be updated. [ 854.720307] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.720652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.720652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.720837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.721058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.734277] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 855.224163] env[69756]: INFO networking_nsxv3.common.synchronization [req-96b6accb-05a5-4cef-bfff-e5582630045f req-e0da843c-02c5-49f9-8de7-e8fb504d7cd3 service nova] Enqueued Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_rules [ 855.224450] env[69756]: INFO networking_nsxv3.common.synchronization [req-96b6accb-05a5-4cef-bfff-e5582630045f req-e0da843c-02c5-49f9-8de7-e8fb504d7cd3 service nova] Enqueued Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_members [ 855.224598] env[69756]: INFO networking_nsxv3.common.synchronization [req-96b6accb-05a5-4cef-bfff-e5582630045f req-e0da843c-02c5-49f9-8de7-e8fb504d7cd3 service nova] Enqueued Resource ID: f67de4f5-bb24-406d-9f4b-c39176e1501e with Priority: HIGHEST for action port [ 855.225575] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_rules [ 855.227490] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_members [ 855.227490] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f67de4f5-bb24-406d-9f4b-c39176e1501e with Priority: HIGHEST for action port [ 855.227490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.227490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.228846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.229047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.229162] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.231773] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa5dd68d-835d-4416-ac9f-cab1591b2b82 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.231925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.232011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.232253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.232458] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.232583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.232680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.232887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.233108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.233169] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.235990] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f67de4f5-bb24-406d-9f4b-c39176e1501e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.235990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f67de4f5-bb24-406d-9f4b-c39176e1501e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.235990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f67de4f5-bb24-406d-9f4b-c39176e1501e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.235990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f67de4f5-bb24-406d-9f4b-c39176e1501e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.235990] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f67de4f5-bb24-406d-9f4b-c39176e1501e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.641891] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 in Status: SUCCESS [ 855.642274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.671439] env[69756]: INFO networking_nsxv3.common.synchronization [req-a9f12584-483c-47bd-bb1d-1e624c951eef req-35feb79c-ad9b-4ceb-839c-5de8d99187c7 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 855.672186] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 855.672549] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.672705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.672755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.673417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.673624] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.673761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.673854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.674086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.674153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.674278] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.737714] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa5dd68d-835d-4416-ac9f-cab1591b2b82 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.737714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.738044] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.741409] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f67de4f5-bb24-406d-9f4b-c39176e1501e with status ACTIVE [ 855.741409] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.741409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.741409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.741409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.741409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.743292] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.743438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.743526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.744776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.744776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.744776] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.744776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.744776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.744776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.744776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.744776] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f67de4f5-bb24-406d-9f4b-c39176e1501e is going to be updated. [ 855.774024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.774024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.774024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.774024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.774024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.774024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f67de4f5-bb24-406d-9f4b-c39176e1501e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.023663] env[69756]: INFO networking_nsxv3.common.synchronization [req-1ecb4a52-d4ce-499b-947c-85800bd4c881 req-2065ba1a-fb85-4960-8dbe-8fd83148e259 tempest-DeleteServersAdminTestJSON-1550782210 tempest-DeleteServersAdminTestJSON-1550782210-project-member] Enqueued Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 856.023858] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGHEST for action security_group_members [ 856.024173] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.024325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.024405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.025248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.025419] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.025526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.025590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.025758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.027505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.027505] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.123024] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.123024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-392" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.123024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-392" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.123024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-392" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.123024] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.123024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.123024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.123024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.123717] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.123977] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.124115] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.125030] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.125030] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.125030] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.125030] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.125030] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.143500] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.143681] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 856.143827] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.144014] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-392" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.144333] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-6266c56a-1d01-4f6a-b0fd-e96b69664915 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.144537] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.144676] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.145126] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.145307] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6266c56a-1d01-4f6a-b0fd-e96b69664915',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.176468] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.176682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.176762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.177079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.177228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.177438] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.177618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.177704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.177872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.177954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.178057] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca already deleted. [ 856.178143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.246781] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.417396] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: SUCCESS [ 856.417594] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 deletion is rescheduled due to dependency. [ 856.417743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.417914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.418154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.418352] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.418473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.418521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.418693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.418778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.418865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.418960] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.529718] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.529856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.529950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.530203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.530327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.530623] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.530623] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.530713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.530851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.530955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.531077] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bf1989-7e31-4042-8158-612d65438abc is going to be updated. [ 856.560157] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.560157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.560157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.560157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.560157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.583248] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: IN_PROGRESS for 2s [ 856.650196] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.650684] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.650845] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.651165] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.651316] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.651475] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 6266c56a-1d01-4f6a-b0fd-e96b69664915 not found, creating... [ 856.651747] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.651907] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.652558] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.652558] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.652558] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.652703] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.652858] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.652972] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.653433] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.653701] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.653972] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 is going to be created. [ 856.677765] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.678186] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.678446] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.679820] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.679820] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.679820] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.746296] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 856.749152] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 deletion is rescheduled due to dependency. [ 856.749152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.751339] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.751476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.751556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.751782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.751866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.751984] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 is going to be created. [ 856.775996] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.776191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.776225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.776441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.776668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.797432] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 in Status: UNINITIALIZED for 2s [ 856.922493] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cae8dc5-dcca-4592-aebe-26bb46462d80',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.425856] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cae8dc5-dcca-4592-aebe-26bb46462d80: rpc.has_security_group_logging(os_id): False [ 857.446567] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.447111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.447111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.447111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.447111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.447318] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.447411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.447477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.447644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.447732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.447821] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 is going to be updated. [ 857.510076] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.510076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.510076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.510076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.510076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.523631] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: IN_PROGRESS for 2s [ 857.529329] env[69756]: INFO networking_nsxv3.common.synchronization [req-a9f12584-483c-47bd-bb1d-1e624c951eef req-5572ff04-8e87-4480-83ec-6a3684a743d7 service nova] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_rules [ 857.530455] env[69756]: INFO networking_nsxv3.common.synchronization [req-a9f12584-483c-47bd-bb1d-1e624c951eef req-5572ff04-8e87-4480-83ec-6a3684a743d7 service nova] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 857.531567] env[69756]: INFO networking_nsxv3.common.synchronization [req-a9f12584-483c-47bd-bb1d-1e624c951eef req-5572ff04-8e87-4480-83ec-6a3684a743d7 service nova] Enqueued Resource ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 with Priority: HIGHEST for action port [ 857.533365] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_rules [ 857.533365] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 857.533365] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 with Priority: HIGHEST for action port [ 857.533365] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.533365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.533365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.533981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.534188] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.537687] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.537929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.538114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.538417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.538646] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.538938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.539788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.539788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.539788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.539788] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.541126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-6266c56a-1d01-4f6a-b0fd-e96b69664915 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.541478] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.541638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.541873] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.542047] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6266c56a-1d01-4f6a-b0fd-e96b69664915',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.038254] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.038558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.041907] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.048249] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6266c56a-1d01-4f6a-b0fd-e96b69664915 with status ACTIVE [ 858.048249] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.048249] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.048249] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.048249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.048249] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 is going to be updated. [ 858.220281] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.220487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.220676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.220830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.221008] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.221208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.546652] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.593965] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bf1989-7e31-4042-8158-612d65438abc in Status: SUCCESS [ 858.594166] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bf1989-7e31-4042-8158-612d65438abc deletion is rescheduled due to dependency. [ 858.594293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.809855] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 in Status: SUCCESS [ 858.810187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.811090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.811383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.811593] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.811717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.811783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.811946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.812037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.812122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.812216] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.049478] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.050433] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.050592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.050971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.051162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.051334] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca is going to be created. [ 859.075872] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.076189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.076347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.078016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.078016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.096732] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: UNINITIALIZED for 2s [ 859.137185] env[69756]: INFO networking_nsxv3.common.synchronization [req-da22b7e2-30d0-41c7-b172-b393acd0956d req-09a3bda9-40c5-4fdc-ae66-dd0a3c16744d tempest-ServersAdminTestJSON-2109728624 tempest-ServersAdminTestJSON-2109728624-project-member] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 859.138363] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 859.138363] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.138363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.138363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.138621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.138621] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.138697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.138697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.138844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.139988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.139988] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.314920] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.514355] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.514573] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.514660] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.514952] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.515224] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.515377] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.515490] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.515707] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.515851] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.516491] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.516669] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.516789] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.516902] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.517026] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.517136] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.517269] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.540675] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cae8dc5-dcca-4592-aebe-26bb46462d80 in Status: SUCCESS [ 859.540932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cae8dc5-dcca-4592-aebe-26bb46462d80" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.541905] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.542100] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.542276] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.542458] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.542824] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-6abae4bf-af56-4abf-b151-69d08e7dfc4b taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.543413] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-6abae4bf-af56-4abf-b151-69d08e7dfc4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.543413] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-6abae4bf-af56-4abf-b151-69d08e7dfc4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.543573] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-6abae4bf-af56-4abf-b151-69d08e7dfc4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.543615] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6abae4bf-af56-4abf-b151-69d08e7dfc4b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.645401] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.823022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa5dd68d-835d-4416-ac9f-cab1591b2b82: rpc.has_security_group_logging(os_id): False [ 859.843324] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.844434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.844434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.844434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.844434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.844740] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.844740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.844863] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.845026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.845114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.845212] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 is going to be created. [ 859.908242] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.908488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.908613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.908942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.909238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.922095] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 in Status: IN_PROGRESS for 2s [ 860.048365] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.048704] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.048998] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.049303] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.049460] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.049736] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 6abae4bf-af56-4abf-b151-69d08e7dfc4b not found, creating... [ 860.050059] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.050232] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.050350] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.050589] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.050745] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.051327] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.051585] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.051763] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.051956] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.052110] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.052265] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 6abae4bf-af56-4abf-b151-69d08e7dfc4b is going to be created. [ 860.083042] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.083287] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.083760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.084120] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.084372] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.084636] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-6abae4bf-af56-4abf-b151-69d08e7dfc4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.148243] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.650678] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.650746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.650823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.651246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.651416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.651585] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 860.687552] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.687770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.687893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.688218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.688425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.699769] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 860.855507] env[69756]: INFO networking_nsxv3.common.synchronization [req-da22b7e2-30d0-41c7-b172-b393acd0956d req-1e934ff4-9bb9-4bab-ba79-9d6e51c8fcab service nova] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_rules [ 860.855688] env[69756]: INFO networking_nsxv3.common.synchronization [req-da22b7e2-30d0-41c7-b172-b393acd0956d req-1e934ff4-9bb9-4bab-ba79-9d6e51c8fcab service nova] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 860.855828] env[69756]: INFO networking_nsxv3.common.synchronization [req-da22b7e2-30d0-41c7-b172-b393acd0956d req-1e934ff4-9bb9-4bab-ba79-9d6e51c8fcab service nova] Enqueued Resource ID: 6abae4bf-af56-4abf-b151-69d08e7dfc4b with Priority: HIGHEST for action port [ 860.856085] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_rules [ 860.856209] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 860.856304] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6abae4bf-af56-4abf-b151-69d08e7dfc4b with Priority: HIGHEST for action port [ 860.864019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.864019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.864019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.864019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.864019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.864019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.864019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.864019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-6abae4bf-af56-4abf-b151-69d08e7dfc4b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.864019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6abae4bf-af56-4abf-b151-69d08e7dfc4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.864019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6abae4bf-af56-4abf-b151-69d08e7dfc4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.864019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6abae4bf-af56-4abf-b151-69d08e7dfc4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.864019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6abae4bf-af56-4abf-b151-69d08e7dfc4b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.108430] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: SUCCESS [ 861.108671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.108833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.109106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.110862] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.110862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.110862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.110862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.110862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.110862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.110862] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.368758] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.368758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.368758] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6abae4bf-af56-4abf-b151-69d08e7dfc4b with status ACTIVE [ 861.368758] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.368758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.368758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.368758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.369041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.369041] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.369282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.369282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.370168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.370168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.370168] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.370168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.370168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.370168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.370421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.370421] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6abae4bf-af56-4abf-b151-69d08e7dfc4b is going to be updated. [ 861.394596] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.394839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.394868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.395372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.395372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.395501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6abae4bf-af56-4abf-b151-69d08e7dfc4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.612871] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.612871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.612871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.612871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.613046] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.613101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.613133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.617030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.617030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.617030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.617030] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.939070] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 in Status: SUCCESS [ 861.939070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.121024] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6da5233-f6f0-4d61-a296-915a5edc7cca: rpc.has_security_group_logging(os_id): False [ 862.139904] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.140239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.140318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.140545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.140640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.141602] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.141602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.141602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.141806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.141927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.142219] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.142408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.142491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.142709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.142771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.142990] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.143163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.143732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.143945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.144126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.144126] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca is going to be created. [ 862.216828] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.217048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.217149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.217389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.217627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.243888] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: IN_PROGRESS for 2s [ 862.713127] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 862.713349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.713539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.713774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.714130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.714130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.714268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.714300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.714480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.714480] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.217535] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.720240] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.223720] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.224087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.224087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.226192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.226192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.226192] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 864.259688] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: SUCCESS [ 864.259911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.266222] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.266371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.266444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.266693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.266839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.277224] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 865.302298] env[69756]: INFO networking_nsxv3.common.synchronization [None req-618b390e-7894-45c9-8a97-80c9181b35e6 None None] Enqueued Resource ID: 8e33c2e8-fe02-4f65-b513-4d1b67536702 with Priority: HIGHEST for action port [ 865.302517] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e33c2e8-fe02-4f65-b513-4d1b67536702 with Priority: HIGHEST for action port [ 865.303023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e33c2e8-fe02-4f65-b513-4d1b67536702 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.303143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e33c2e8-fe02-4f65-b513-4d1b67536702" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.303236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e33c2e8-fe02-4f65-b513-4d1b67536702" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.303466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e33c2e8-fe02-4f65-b513-4d1b67536702" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.303546] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e33c2e8-fe02-4f65-b513-4d1b67536702',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.805964] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e33c2e8-fe02-4f65-b513-4d1b67536702 [ 865.806179] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.806314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.806384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.806607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.806743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.806848] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e33c2e8-fe02-4f65-b513-4d1b67536702 already deleted. [ 865.806934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e33c2e8-fe02-4f65-b513-4d1b67536702" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.288839] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 866.289078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.289244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.289467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.289865] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.289995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.290082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.290244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.290327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.290415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.290503] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.368684] env[69756]: INFO networking_nsxv3.common.synchronization [req-39491f7a-b4a9-4344-b2ac-ba36d8143e5b req-483bb39b-d49e-4b58-9dbf-5d269e98ccb4 tempest-InstanceActionsTestJSON-373971737 tempest-InstanceActionsTestJSON-373971737-project-member] Enqueued Resource ID: 3669143c-24cd-4014-976c-a88fbc9ce9be with Priority: HIGHEST for action security_group_members [ 866.369372] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3669143c-24cd-4014-976c-a88fbc9ce9be with Priority: HIGHEST for action security_group_members [ 866.369804] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3669143c-24cd-4014-976c-a88fbc9ce9be taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.369804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.369945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.374256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.374256] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.374256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.374256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.374256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.374256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.374256] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3669143c-24cd-4014-976c-a88fbc9ce9be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.793702] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.793702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.793702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.793996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.794039] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.794170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.794240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.794726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.794726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.794726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.794885] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.794885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.794964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.795090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.795243] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.795332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.795391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.795542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.795660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.795690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.796132] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.820403] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-335 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.820403] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-335" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.820590] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-335" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.820951] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-335" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.821074] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.821234] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.821349] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.821593] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.821752] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.821964] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.825505] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.825846] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.825846] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.825950] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.826930] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.826930] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.849820] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.849820] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 866.849820] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.849820] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-335" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.849820] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.849820] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.849820] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.849820] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.849820] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.878425] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.878425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.878425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.878425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.878425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.878425] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.878425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.878425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.878425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.878425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.878425] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3669143c-24cd-4014-976c-a88fbc9ce9be already deleted. [ 866.878425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.300581] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734: rpc.has_security_group_logging(os_id): False [ 867.342187] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.342430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.342430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.342704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.342704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.342941] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.343091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.343172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.343290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.343378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.343575] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.343709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.343709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.343847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.343928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.344859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.345079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.345188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.345442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.345547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.345698] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 867.353978] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.354338] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.354531] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.354985] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.355229] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.355462] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d not found, creating... [ 867.355870] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.356721] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.356899] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.357284] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.357503] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.357984] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.358236] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.358420] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.358840] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.358958] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.359339] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d is going to be created. [ 867.411496] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.411881] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.412626] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.412806] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.413069] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.413305] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.481129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.482680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.482680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.482680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.482680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.505777] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 867.592666] env[69756]: INFO networking_nsxv3.common.synchronization [None req-83a23bec-1370-475a-80bb-d2876d0a3fe0 None None] Enqueued Resource ID: 5accd9cb-e198-4543-89dc-a3c70e76c669 with Priority: HIGHEST for action port [ 867.592817] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5accd9cb-e198-4543-89dc-a3c70e76c669 with Priority: HIGHEST for action port [ 867.595741] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5accd9cb-e198-4543-89dc-a3c70e76c669 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.595741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5accd9cb-e198-4543-89dc-a3c70e76c669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.595741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5accd9cb-e198-4543-89dc-a3c70e76c669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.595741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5accd9cb-e198-4543-89dc-a3c70e76c669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.595741] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5accd9cb-e198-4543-89dc-a3c70e76c669',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.101460] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5accd9cb-e198-4543-89dc-a3c70e76c669 [ 868.101691] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.101822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.101887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.102152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.102245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.102344] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5accd9cb-e198-4543-89dc-a3c70e76c669 already deleted. [ 868.102555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5accd9cb-e198-4543-89dc-a3c70e76c669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.249295] env[69756]: INFO networking_nsxv3.common.synchronization [req-39491f7a-b4a9-4344-b2ac-ba36d8143e5b req-94670ef0-af35-43c8-9dac-0f02fded0d42 service nova] Enqueued Resource ID: 3669143c-24cd-4014-976c-a88fbc9ce9be with Priority: HIGHEST for action security_group_rules [ 868.249295] env[69756]: INFO networking_nsxv3.common.synchronization [req-39491f7a-b4a9-4344-b2ac-ba36d8143e5b req-94670ef0-af35-43c8-9dac-0f02fded0d42 service nova] Enqueued Resource ID: 3669143c-24cd-4014-976c-a88fbc9ce9be with Priority: HIGHEST for action security_group_members [ 868.249295] env[69756]: INFO networking_nsxv3.common.synchronization [req-39491f7a-b4a9-4344-b2ac-ba36d8143e5b req-94670ef0-af35-43c8-9dac-0f02fded0d42 service nova] Enqueued Resource ID: e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d with Priority: HIGHEST for action port [ 868.249295] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3669143c-24cd-4014-976c-a88fbc9ce9be with Priority: HIGHEST for action security_group_rules [ 868.249295] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3669143c-24cd-4014-976c-a88fbc9ce9be with Priority: HIGHEST for action security_group_members [ 868.249295] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d with Priority: HIGHEST for action port [ 868.249295] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3669143c-24cd-4014-976c-a88fbc9ce9be taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.249295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.249295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.251039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.251039] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3669143c-24cd-4014-976c-a88fbc9ce9be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.251535] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3669143c-24cd-4014-976c-a88fbc9ce9be taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.251895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.251895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.252032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.252110] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.252220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.252281] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.252433] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.252516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.252625] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3669143c-24cd-4014-976c-a88fbc9ce9be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.253499] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.253617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.254875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.254875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.254875] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.757273] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3669143c-24cd-4014-976c-a88fbc9ce9be taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.757569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.757640] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3669143c-24cd-4014-976c-a88fbc9ce9be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.758563] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d with status ACTIVE [ 868.759058] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.759058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.759058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.759218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.759218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.759791] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.759791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.759791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.759791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.759791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.759989] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.760112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.760112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.760227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.760278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.760364] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d is going to be updated. [ 868.783093] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.783093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.783093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.783428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.783428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.783657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e44f8a7d-3e0e-4046-a594-6cd4f5e69f2d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.113017] env[69756]: INFO networking_nsxv3.common.synchronization [req-a273b944-c382-4b5c-9e72-6a55d16c0008 req-1620a2b7-3bd4-432d-a2a4-4dd7f3683909 tempest-FloatingIPsAssociationNegativeTestJSON-147895576 tempest-FloatingIPsAssociationNegativeTestJSON-147895576-project-member] Enqueued Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGHEST for action security_group_members [ 869.113530] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGHEST for action security_group_members [ 869.113823] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.113939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.114014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.115252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.115252] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.115252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.115252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.115252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.115529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.115529] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa06de64-a891-4a6e-b4a0-eb1e3a875e9e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.262665] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3669143c-24cd-4014-976c-a88fbc9ce9be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.546283] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 869.546283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.577209] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-340 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.577411] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-340" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.577535] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-340" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.577879] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-340" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.578536] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.578778] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.578966] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.579275] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.579492] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.579761] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.579924] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.580094] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.580261] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.580425] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.580578] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.580761] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.600058] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.600347] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 869.600552] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.601690] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-340" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.601690] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-cee8d8d7-a128-42dc-9cde-ba5576b02e39 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.601690] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-cee8d8d7-a128-42dc-9cde-ba5576b02e39" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.601690] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-cee8d8d7-a128-42dc-9cde-ba5576b02e39" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.602065] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-cee8d8d7-a128-42dc-9cde-ba5576b02e39" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.602267] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cee8d8d7-a128-42dc-9cde-ba5576b02e39',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.617575] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.617714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.617782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.617996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.618181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.618440] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.618575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.618640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.618833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.618910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.619039] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e already deleted. [ 869.619144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.767623] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.767623] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.768058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.768295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.769035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.769035] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3669143c-24cd-4014-976c-a88fbc9ce9be is going to be created. [ 869.798678] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.798678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.798678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.798678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.798847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.811480] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3669143c-24cd-4014-976c-a88fbc9ce9be in Status: UNINITIALIZED for 2s [ 870.104670] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.104922] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.105075] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.105351] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.105501] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.105654] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port cee8d8d7-a128-42dc-9cde-ba5576b02e39 not found, creating... [ 870.105931] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.106175] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.106321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.106537] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.106686] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.107441] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.107441] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.107441] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.107699] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.107756] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.107862] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: cee8d8d7-a128-42dc-9cde-ba5576b02e39 is going to be created. [ 870.133186] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.133186] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.133395] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.133753] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.134171] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.134518] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-cee8d8d7-a128-42dc-9cde-ba5576b02e39" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.900363] env[69756]: INFO networking_nsxv3.common.synchronization [req-a273b944-c382-4b5c-9e72-6a55d16c0008 req-9d60986f-4c79-45ff-8089-2922fb3daf47 service nova] Enqueued Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGHEST for action security_group_rules [ 870.900621] env[69756]: INFO networking_nsxv3.common.synchronization [req-a273b944-c382-4b5c-9e72-6a55d16c0008 req-9d60986f-4c79-45ff-8089-2922fb3daf47 service nova] Enqueued Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGHEST for action security_group_members [ 870.900665] env[69756]: INFO networking_nsxv3.common.synchronization [req-a273b944-c382-4b5c-9e72-6a55d16c0008 req-9d60986f-4c79-45ff-8089-2922fb3daf47 service nova] Enqueued Resource ID: cee8d8d7-a128-42dc-9cde-ba5576b02e39 with Priority: HIGHEST for action port [ 870.901426] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGHEST for action security_group_rules [ 870.901560] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGHEST for action security_group_members [ 870.901651] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee8d8d7-a128-42dc-9cde-ba5576b02e39 with Priority: HIGHEST for action port [ 870.902059] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.902509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.902509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.902509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.902641] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa06de64-a891-4a6e-b4a0-eb1e3a875e9e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.903507] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.903634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.903704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.903912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.904045] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.904321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.904321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.904321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.904406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.904495] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa06de64-a891-4a6e-b4a0-eb1e3a875e9e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.910855] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-cee8d8d7-a128-42dc-9cde-ba5576b02e39 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.910855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cee8d8d7-a128-42dc-9cde-ba5576b02e39" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.910855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cee8d8d7-a128-42dc-9cde-ba5576b02e39" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.910855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cee8d8d7-a128-42dc-9cde-ba5576b02e39" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.910855] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cee8d8d7-a128-42dc-9cde-ba5576b02e39',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.410882] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.411011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.411228] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa06de64-a891-4a6e-b4a0-eb1e3a875e9e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.412132] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cee8d8d7-a128-42dc-9cde-ba5576b02e39 with status ACTIVE [ 871.412350] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.412466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.412533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.412737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.412845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.413075] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.413143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.413239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.413363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.413443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.413626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.413719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.413779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.413918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.413991] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.414088] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cee8d8d7-a128-42dc-9cde-ba5576b02e39 is going to be updated. [ 871.437952] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.438126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.438179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.438784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.438784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.438784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cee8d8d7-a128-42dc-9cde-ba5576b02e39" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.822631] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3669143c-24cd-4014-976c-a88fbc9ce9be in Status: SUCCESS [ 871.822905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.823201] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.823681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.823914] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.824059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.824124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.824340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.824419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.824511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.824630] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3669143c-24cd-4014-976c-a88fbc9ce9be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.916434] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa06de64-a891-4a6e-b4a0-eb1e3a875e9e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.330987] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3669143c-24cd-4014-976c-a88fbc9ce9be taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.331171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.331240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.331457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.331624] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.331737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.331798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.331951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.332056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.332171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.332296] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3669143c-24cd-4014-976c-a88fbc9ce9be taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.332390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.332454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.332589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.332793] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.332852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.332880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.332996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.333083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.333163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.333352] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3669143c-24cd-4014-976c-a88fbc9ce9be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.419520] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.419778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.419778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.420081] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.420182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.420289] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e is going to be created. [ 872.450470] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.450470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.450470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.450470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.450470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.466266] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e in Status: UNINITIALIZED for 2s [ 872.835689] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3669143c-24cd-4014-976c-a88fbc9ce9be: rpc.has_security_group_logging(os_id): False [ 872.858749] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.858988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.859122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.859439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.859590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.859880] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.860053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.860163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.860504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.860570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.860824] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.860983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.861113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.861338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.861468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.861774] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.861929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.862062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.862288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.862432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.862576] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3669143c-24cd-4014-976c-a88fbc9ce9be is going to be created. [ 872.926275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.926275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.926920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.926920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.926920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.938279] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3669143c-24cd-4014-976c-a88fbc9ce9be in Status: IN_PROGRESS for 2s [ 874.200456] env[69756]: INFO networking_nsxv3.common.synchronization [req-0eadc8d8-dfd7-4cbd-af0a-5e68ddae2c4e req-56b90da1-32ea-4797-a695-c2cbee9ef0b7 tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 874.201120] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 874.201313] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.201429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.201491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.201734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.201913] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.202798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.202931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.203132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.203226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.203324] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.477394] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e in Status: SUCCESS [ 874.477714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.478028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.478350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.478622] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.478814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.478928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.480645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.480819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.481050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.481153] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa06de64-a891-4a6e-b4a0-eb1e3a875e9e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.637092] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.637092] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.637092] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.637092] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.637092] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.637092] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.637092] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.637838] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.637838] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.637838] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.637981] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.638115] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.638178] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.638286] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.638451] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.638591] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.660872] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.661402] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 874.661803] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.662157] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.662952] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-0a354daa-3276-4f28-9f9b-0bff6a78aa31 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.663350] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-0a354daa-3276-4f28-9f9b-0bff6a78aa31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.663683] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-0a354daa-3276-4f28-9f9b-0bff6a78aa31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.664424] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-0a354daa-3276-4f28-9f9b-0bff6a78aa31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.664724] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a354daa-3276-4f28-9f9b-0bff6a78aa31',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.705759] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.706913] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.707051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.707360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.707606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.707732] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.707923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.707984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.708175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.708253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.708362] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b already deleted. [ 874.708452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.951626] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3669143c-24cd-4014-976c-a88fbc9ce9be in Status: SUCCESS [ 874.951862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.986313] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.986479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.986548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.986776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.987025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.987189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.987189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.987378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.989308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.989479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.989674] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.989757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.989826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.990046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.990219] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.990320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.990385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.990535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.990622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.990691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.990793] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa06de64-a891-4a6e-b4a0-eb1e3a875e9e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.168349] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.168848] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.168848] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.169079] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.169503] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.169799] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 0a354daa-3276-4f28-9f9b-0bff6a78aa31 not found, creating... [ 875.170246] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.170488] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.170624] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.170868] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.171020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.171322] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.171475] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.171590] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.171804] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.171938] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.172091] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 0a354daa-3276-4f28-9f9b-0bff6a78aa31 is going to be created. [ 875.193938] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.193938] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.194223] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.194270] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.194478] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.194703] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-0a354daa-3276-4f28-9f9b-0bff6a78aa31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.391263] env[69756]: INFO networking_nsxv3.common.synchronization [req-a62c4f2f-6fab-4c04-9a41-38d674fbc8a3 req-665e887c-d015-4258-8572-1869fc36a8f4 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 875.391506] env[69756]: INFO networking_nsxv3.common.synchronization [req-a62c4f2f-6fab-4c04-9a41-38d674fbc8a3 req-665e887c-d015-4258-8572-1869fc36a8f4 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d with Priority: HIGHEST for action security_group_members [ 875.391943] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 875.392638] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d with Priority: HIGHEST for action security_group_members [ 875.392638] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.392790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.392790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.392999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.393209] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.393347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.394393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.394393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.394393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.394393] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.395941] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.395941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.395941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.395941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.396074] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.396230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.396230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.398120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.398120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.398120] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14f8ed12-aaa5-4d4d-9e00-912de55f6d9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.451313] env[69756]: INFO networking_nsxv3.common.synchronization [req-a62c4f2f-6fab-4c04-9a41-38d674fbc8a3 req-665e887c-d015-4258-8572-1869fc36a8f4 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d with Priority: HIGHEST for action security_group_rules [ 875.451522] env[69756]: INFO networking_nsxv3.common.synchronization [req-a62c4f2f-6fab-4c04-9a41-38d674fbc8a3 req-665e887c-d015-4258-8572-1869fc36a8f4 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d with Priority: HIGHEST for action security_group_members [ 875.451690] env[69756]: INFO networking_nsxv3.common.synchronization [req-a62c4f2f-6fab-4c04-9a41-38d674fbc8a3 req-665e887c-d015-4258-8572-1869fc36a8f4 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_rules [ 875.451851] env[69756]: INFO networking_nsxv3.common.synchronization [req-a62c4f2f-6fab-4c04-9a41-38d674fbc8a3 req-665e887c-d015-4258-8572-1869fc36a8f4 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 875.452174] env[69756]: INFO networking_nsxv3.common.synchronization [req-a62c4f2f-6fab-4c04-9a41-38d674fbc8a3 req-665e887c-d015-4258-8572-1869fc36a8f4 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 with Priority: HIGHEST for action port [ 875.452738] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d with Priority: HIGHEST for action security_group_rules [ 875.452912] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_rules [ 875.453026] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 with Priority: HIGHEST for action port [ 875.453158] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d with Priority: HIGHEST for action security_group_members [ 875.453273] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 875.453583] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.453725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.453808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.454121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.454225] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14f8ed12-aaa5-4d4d-9e00-912de55f6d9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.456862] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.456996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.457046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.457277] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.457522] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.459418] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-6266c56a-1d01-4f6a-b0fd-e96b69664915 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.459555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.459629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.459803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.459926] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6266c56a-1d01-4f6a-b0fd-e96b69664915',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.462196] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.462311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.462523] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.462638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.493888] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa06de64-a891-4a6e-b4a0-eb1e3a875e9e: rpc.has_security_group_logging(os_id): False [ 875.519753] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.519890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.519958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.520301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.520366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.520623] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.520740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.520833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.521017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.521137] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.521364] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.522284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.522284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.522284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.522284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.522284] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.522764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.522764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.523323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.523323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.523323] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e is going to be created. [ 875.601498] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.601664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.604608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.604608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.604608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.623437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e in Status: IN_PROGRESS for 2s [ 875.896168] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.898285] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14f8ed12-aaa5-4d4d-9e00-912de55f6d9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.961483] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.961620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.961904] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.961990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.962163] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6266c56a-1d01-4f6a-b0fd-e96b69664915 with status ACTIVE [ 875.962315] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.962420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.962486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.962707] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.962798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.962965] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.963075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.963135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.963289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.963365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.963538] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.963645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.963708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.963851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.963929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.964022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 is going to be updated. [ 875.985683] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.985916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.986172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.986395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.986594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.986836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.115515] env[69756]: INFO networking_nsxv3.common.synchronization [req-10bcd842-8ce9-4f69-a7d4-5c33490b6d7c req-d2320fb4-6b27-4beb-9c26-7e871cb1d305 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 876.115601] env[69756]: INFO networking_nsxv3.common.synchronization [req-10bcd842-8ce9-4f69-a7d4-5c33490b6d7c req-d2320fb4-6b27-4beb-9c26-7e871cb1d305 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d with Priority: HIGHEST for action security_group_members [ 876.118806] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 876.118976] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d with Priority: HIGHEST for action security_group_members [ 876.119376] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.119465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.119593] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.119675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.138358] env[69756]: INFO networking_nsxv3.common.synchronization [req-0eadc8d8-dfd7-4cbd-af0a-5e68ddae2c4e req-593a0c1c-8168-4044-ad67-48ffa51a7772 service nova] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_rules [ 876.138358] env[69756]: INFO networking_nsxv3.common.synchronization [req-0eadc8d8-dfd7-4cbd-af0a-5e68ddae2c4e req-593a0c1c-8168-4044-ad67-48ffa51a7772 service nova] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 876.138358] env[69756]: INFO networking_nsxv3.common.synchronization [req-0eadc8d8-dfd7-4cbd-af0a-5e68ddae2c4e req-593a0c1c-8168-4044-ad67-48ffa51a7772 service nova] Enqueued Resource ID: 0a354daa-3276-4f28-9f9b-0bff6a78aa31 with Priority: HIGHEST for action port [ 876.138358] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_rules [ 876.138358] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 876.138358] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a354daa-3276-4f28-9f9b-0bff6a78aa31 with Priority: HIGHEST for action port [ 876.138872] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.138872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.138872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.139289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.139289] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.140129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.141139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.141139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.141139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.141139] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.141139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.141139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.141139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.141139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.141443] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.141943] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a354daa-3276-4f28-9f9b-0bff6a78aa31 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.142136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a354daa-3276-4f28-9f9b-0bff6a78aa31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.142222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a354daa-3276-4f28-9f9b-0bff6a78aa31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.142376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a354daa-3276-4f28-9f9b-0bff6a78aa31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.142432] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a354daa-3276-4f28-9f9b-0bff6a78aa31',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.205633] env[69756]: INFO networking_nsxv3.common.synchronization [req-10bcd842-8ce9-4f69-a7d4-5c33490b6d7c req-d2320fb4-6b27-4beb-9c26-7e871cb1d305 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_rules [ 876.205832] env[69756]: INFO networking_nsxv3.common.synchronization [req-10bcd842-8ce9-4f69-a7d4-5c33490b6d7c req-d2320fb4-6b27-4beb-9c26-7e871cb1d305 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 876.205974] env[69756]: INFO networking_nsxv3.common.synchronization [req-10bcd842-8ce9-4f69-a7d4-5c33490b6d7c req-d2320fb4-6b27-4beb-9c26-7e871cb1d305 tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 with Priority: HIGHEST for action port [ 876.207102] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_rules [ 876.207182] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 876.207268] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 with Priority: HIGHEST for action port [ 876.207589] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.207694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.207942] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.208115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.208320] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-6266c56a-1d01-4f6a-b0fd-e96b69664915 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.208452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.208515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.208763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.208847] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6266c56a-1d01-4f6a-b0fd-e96b69664915',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.401382] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14f8ed12-aaa5-4d4d-9e00-912de55f6d9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.402233] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.644680] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.645061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.645359] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.649199] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a354daa-3276-4f28-9f9b-0bff6a78aa31 with status ACTIVE [ 876.649337] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.649544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.649591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.649829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.649924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.651033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.651033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.651033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.651033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.651033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.651033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.651033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.651033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.653028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.653028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.653028] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a354daa-3276-4f28-9f9b-0bff6a78aa31 is going to be updated. [ 876.682938] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.683129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.683181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.683462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.683605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.683775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a354daa-3276-4f28-9f9b-0bff6a78aa31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.712516] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6266c56a-1d01-4f6a-b0fd-e96b69664915 with status ACTIVE [ 876.713435] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.718028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.718028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.718028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.718028] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6266c56a-1d01-4f6a-b0fd-e96b69664915 is going to be updated. [ 876.752014] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.752196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.752270] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.752483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.752617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.752772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6266c56a-1d01-4f6a-b0fd-e96b69664915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.903665] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.903833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.903879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.904200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.904295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.904400] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d is going to be created. [ 876.905942] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.906110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.906178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.906380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.906472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.906568] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca is going to be updated. [ 876.943787] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.944069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.944168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.944508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.944752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.953825] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.954043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.954043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.954263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.954495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.959618] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d in Status: UNINITIALIZED for 2s [ 876.971778] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: IN_PROGRESS for 2s [ 877.155472] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.636366] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e in Status: SUCCESS [ 877.636734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.658283] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.658442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.658517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.658744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.658844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.658952] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b is going to be created. [ 877.683290] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.683702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.683863] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.684111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.684354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.695215] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: UNINITIALIZED for 2s [ 878.398400] env[69756]: INFO networking_nsxv3.common.synchronization [req-a72e1c4a-0b85-4e75-a72e-c750314239be req-2e66bd68-7659-4109-81f3-1beb08c701bc tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 878.402822] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 878.403453] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.403584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.403643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.403892] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.404033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.404125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.404167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.404325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.404407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.404502] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.836114] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.836386] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.836431] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.836704] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.836964] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.837137] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.837254] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.837470] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.837615] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.837841] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.837931] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.838219] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.838380] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.838534] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.838674] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.838839] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.858307] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.858479] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 878.858625] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.858802] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.859328] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-21bbcb6f-adf4-4372-816e-612d3d7a702c taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.859517] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-21bbcb6f-adf4-4372-816e-612d3d7a702c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.859639] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-21bbcb6f-adf4-4372-816e-612d3d7a702c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.859984] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-21bbcb6f-adf4-4372-816e-612d3d7a702c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.860140] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21bbcb6f-adf4-4372-816e-612d3d7a702c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.908349] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.972502] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d in Status: SUCCESS [ 878.972502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.972502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.972502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.972620] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.972870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.972870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.972970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.973872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.973872] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14f8ed12-aaa5-4d4d-9e00-912de55f6d9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.984112] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: SUCCESS [ 878.984112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.984112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.984258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.984825] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.985029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.985133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.985716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.985781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.986124] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.363132] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.363384] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.363534] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.363790] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.363942] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.364245] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 21bbcb6f-adf4-4372-816e-612d3d7a702c not found, creating... [ 879.365031] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.365031] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.365031] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.365346] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.365409] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.365672] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.366217] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.366217] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.366363] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.366417] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.368222] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 21bbcb6f-adf4-4372-816e-612d3d7a702c is going to be created. [ 879.388322] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.388533] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.388657] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.388941] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.389196] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.389445] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-21bbcb6f-adf4-4372-816e-612d3d7a702c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.411231] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.477987] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.478221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.478264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.480465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.480465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.480465] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.480465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.480465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.480718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.480718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.480718] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d is going to be deleted. [ 879.489333] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.523418] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.523875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.523959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.524223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.524315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.524413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.524564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.524723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.524901] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.525010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.526125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.526125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.526125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.526125] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14f8ed12-aaa5-4d4d-9e00-912de55f6d9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.708300] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: SUCCESS [ 879.708543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.708883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.709156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.710014] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.710144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.710214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.710797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.710915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.711020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.711124] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.913075] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.915575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.915575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.915575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.915575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.915575] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 879.945710] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.945880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.945936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.946184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.946336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.956724] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 879.993103] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.034032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.034032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.034032] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d already deleted. [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.034032] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14f8ed12-aaa5-4d4d-9e00-912de55f6d9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.034032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.034032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.034607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.034607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.034607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.034607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.035326] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14f8ed12-aaa5-4d4d-9e00-912de55f6d9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.191656] env[69756]: INFO networking_nsxv3.common.synchronization [req-a72e1c4a-0b85-4e75-a72e-c750314239be req-1a792820-b23c-4436-9f42-9bcad3848cd4 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 880.191894] env[69756]: INFO networking_nsxv3.common.synchronization [req-a72e1c4a-0b85-4e75-a72e-c750314239be req-1a792820-b23c-4436-9f42-9bcad3848cd4 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 880.192133] env[69756]: INFO networking_nsxv3.common.synchronization [req-a72e1c4a-0b85-4e75-a72e-c750314239be req-1a792820-b23c-4436-9f42-9bcad3848cd4 service nova] Enqueued Resource ID: 21bbcb6f-adf4-4372-816e-612d3d7a702c with Priority: HIGHEST for action port [ 880.192665] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 880.192845] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 880.192984] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21bbcb6f-adf4-4372-816e-612d3d7a702c with Priority: HIGHEST for action port [ 880.193517] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.193689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.193845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.194070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.194187] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.195908] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.196083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.196360] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-21bbcb6f-adf4-4372-816e-612d3d7a702c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.196499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21bbcb6f-adf4-4372-816e-612d3d7a702c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.196591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21bbcb6f-adf4-4372-816e-612d3d7a702c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.196831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21bbcb6f-adf4-4372-816e-612d3d7a702c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.196945] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21bbcb6f-adf4-4372-816e-612d3d7a702c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.213656] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.494491] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.494936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.494936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.495199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.495199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.495199] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca is going to be updated. [ 880.530065] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.530220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.530333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.530602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.530766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.537136] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14f8ed12-aaa5-4d4d-9e00-912de55f6d9d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.538469] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.538469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.538717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.538770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.538814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.539024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.539180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.539244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.539409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.539489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.539575] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d already deleted. [ 880.539864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.543293] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: IN_PROGRESS for 2s [ 880.696118] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.696272] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.701652] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21bbcb6f-adf4-4372-816e-612d3d7a702c with status ACTIVE [ 880.701857] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.702015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.702062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.702309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.702344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.702504] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.702598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.702667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.702805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.702887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.703106] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.703211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.703318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.703411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.703498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.703564] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21bbcb6f-adf4-4372-816e-612d3d7a702c is going to be updated. [ 880.716513] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91d49c48-1e8f-4b77-9b74-b8d508a2115b: rpc.has_security_group_logging(os_id): False [ 880.726612] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.726745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.726939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.727185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.727254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.727363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21bbcb6f-adf4-4372-816e-612d3d7a702c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.734691] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.734862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.734958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.735189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.735274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.737153] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.737153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.737153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.737153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.737153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.737153] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b is going to be created. [ 880.803493] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.803738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.803835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.804095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.804295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.829520] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: IN_PROGRESS for 2s [ 881.041583] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d: rpc.has_security_group_logging(os_id): False [ 881.063059] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.063059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.063059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.063059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.063059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.063059] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.063059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.063059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.063059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.064404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.064404] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d is going to be created. [ 881.083367] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/14f8ed12-aaa5-4d4d-9e00-912de55f6d9d], does not exist path=[/infra/domains/default/groups/14f8ed12-aaa5-4d4d-9e00-912de55f6d9d]."\n}' [ 881.083523] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/14f8ed12-aaa5-4d4d-9e00-912de55f6d9d [ 881.083609] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 881.121675] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.121813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.121885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.122104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.123050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.123279] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.123379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.123451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.123594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.123665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.123853] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.123960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.123995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.128263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.128382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.128494] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14f8ed12-aaa5-4d4d-9e00-912de55f6d9d is going to be created. [ 881.146866] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/14f8ed12-aaa5-4d4d-9e00-912de55f6d9d], does not exist path=[/infra/domains/default/groups/14f8ed12-aaa5-4d4d-9e00-912de55f6d9d]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/14f8ed12-aaa5-4d4d-9e00-912de55f6d9d [ 881.149324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14f8ed12-aaa5-4d4d-9e00-912de55f6d9d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.149558] env[69756]: Traceback (most recent call last): [ 881.149929] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 881.149929] env[69756]: return func(*args, **kwargs) [ 881.149929] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 881.149929] env[69756]: res.raise_for_status() [ 881.149929] env[69756]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 881.149929] env[69756]: raise HTTPError(http_error_msg, response=self) [ 881.149929] env[69756]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/14f8ed12-aaa5-4d4d-9e00-912de55f6d9d [ 881.149929] env[69756]: During handling of the above exception, another exception occurred: [ 881.149929] env[69756]: Traceback (most recent call last): [ 881.149929] env[69756]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 881.149929] env[69756]: listener.cb(fileno) [ 881.149929] env[69756]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 881.149929] env[69756]: result = function(*args, **kwargs) [ 881.149929] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 881.149929] env[69756]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 881.149929] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 881.149929] env[69756]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 881.149929] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 881.149929] env[69756]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 881.149929] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 881.149929] env[69756]: res.raise_for_status() [ 881.149929] env[69756]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 881.149929] env[69756]: raise HTTPError(http_error_msg, response=self) [ 881.149929] env[69756]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/14f8ed12-aaa5-4d4d-9e00-912de55f6d9d [ 881.149929] env[69756]: Removing descriptor: 28 [ 881.968053] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 881.968151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.968331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.968551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.968737] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.968852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.968918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.969092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.969177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.969294] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.472053] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.554803] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: SUCCESS [ 882.555088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.555273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.555493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.555693] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.555814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.555880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.556044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.556126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.556210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.556307] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.560485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.560722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.560887] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.561014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.561078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.561235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.561320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.561414] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.843914] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: SUCCESS [ 882.843914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.893762] env[69756]: INFO networking_nsxv3.common.synchronization [None req-fa0cc2bd-2b79-460b-9f9d-4b98a45b6e63 tempest-MigrationsAdminTest-188051455 tempest-MigrationsAdminTest-188051455-project-member] Enqueued Resource ID: 9820968c-6f9d-42df-93d2-471f76e5548b with Priority: HIGHEST for action security_group_rules [ 882.893762] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9820968c-6f9d-42df-93d2-471f76e5548b with Priority: HIGHEST for action security_group_rules [ 882.893762] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9820968c-6f9d-42df-93d2-471f76e5548b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.893762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9820968c-6f9d-42df-93d2-471f76e5548b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.893762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9820968c-6f9d-42df-93d2-471f76e5548b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.894348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9820968c-6f9d-42df-93d2-471f76e5548b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.894576] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9820968c-6f9d-42df-93d2-471f76e5548b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.975137] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.013655] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b713041a-2f44-4691-8351-713f6dfb7374 tempest-MigrationsAdminTest-188051455 tempest-MigrationsAdminTest-188051455-project-member] Enqueued Resource ID: 9820968c-6f9d-42df-93d2-471f76e5548b with Priority: HIGHEST for action security_group_rules [ 883.014530] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9820968c-6f9d-42df-93d2-471f76e5548b with Priority: HIGHEST for action security_group_rules [ 883.014874] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9820968c-6f9d-42df-93d2-471f76e5548b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.015016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9820968c-6f9d-42df-93d2-471f76e5548b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.061567] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.061567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.063623] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.414601] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.414850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.414850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.415095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.415196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.415296] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9820968c-6f9d-42df-93d2-471f76e5548b already deleted. [ 883.415380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9820968c-6f9d-42df-93d2-471f76e5548b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.415543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9820968c-6f9d-42df-93d2-471f76e5548b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.415712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9820968c-6f9d-42df-93d2-471f76e5548b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.415792] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9820968c-6f9d-42df-93d2-471f76e5548b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.478072] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.478471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.478471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.478550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.478593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.478725] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 883.513681] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.514134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.514134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.514238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.514376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.526225] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 883.565306] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.935746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.935897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.935970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.936234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.936449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.936449] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9820968c-6f9d-42df-93d2-471f76e5548b already deleted. [ 883.936512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9820968c-6f9d-42df-93d2-471f76e5548b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.068389] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.068389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.068389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.068623] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.068786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.069612] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca is going to be updated. [ 884.104024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.104024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.104024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.104024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.104024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.115850] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: IN_PROGRESS for 2s [ 885.388277] env[69756]: INFO networking_nsxv3.common.synchronization [req-557ed457-15b2-435d-b631-536b823f173b req-1ede9026-c4f3-4fdc-b862-b398da4cc2cb tempest-ServerRescueTestJSONUnderV235-54723283 tempest-ServerRescueTestJSONUnderV235-54723283-project-member] Enqueued Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 885.388277] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6da5233-f6f0-4d61-a296-915a5edc7cca with Priority: HIGHEST for action security_group_members [ 885.388910] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.389285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.537084] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 885.537591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.538177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.540906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.540906] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.540906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.540906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.540906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.540906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.540906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.540906] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.042755] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.042755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.042755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.042934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.043034] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.043129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.043190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.043331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.043414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.043497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.043633] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.043719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.043775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.043908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.046019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.046019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.046019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.046019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.046019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.046019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.046019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.125807] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: SUCCESS [ 886.126044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.126575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.126851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.127090] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.127223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.127306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.127464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.127521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.127612] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.180090] env[69756]: INFO networking_nsxv3.common.synchronization [req-c50c818d-fc82-42ad-a765-e24f226ab574 req-0a95524d-17b1-44be-be31-6b4f5d3625ff tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 886.180090] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 886.180090] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.180090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.180534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.180929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.181284] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.183636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.183636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.183636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.183636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.183636] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.331048] env[69756]: INFO networking_nsxv3.common.synchronization [req-ea268917-84c9-4e10-add8-6c118e9d1918 req-82eb1e80-201a-4edb-a855-c658b6b4e871 tempest-InstanceActionsTestJSON-373971737 tempest-InstanceActionsTestJSON-373971737-project-member] Enqueued Resource ID: 3669143c-24cd-4014-976c-a88fbc9ce9be with Priority: HIGHEST for action security_group_members [ 886.331048] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3669143c-24cd-4014-976c-a88fbc9ce9be with Priority: HIGHEST for action security_group_members [ 886.331048] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3669143c-24cd-4014-976c-a88fbc9ce9be taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.331048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.331048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.331048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.331048] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.331048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.331048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.331048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.331048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.331048] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3669143c-24cd-4014-976c-a88fbc9ce9be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.548887] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8feed-cd04-49d0-9fbe-c89808cf758f: rpc.has_security_group_logging(os_id): False [ 886.571869] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.572100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.572205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.572501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.594583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.594890] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.595041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.595077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.595271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.595356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.596220] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.596341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.596409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.596575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.596653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.596842] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.596935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.597073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.597232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.597308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.597394] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 886.635621] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.635826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.635826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.636069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.660583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.660583] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.660583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.660583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.660583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.660583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.660927] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca is going to be updated. [ 886.664195] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.664434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.664545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.664816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.665014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.684686] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.684869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.684912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.685232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.685329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.685558] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.685680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.685753] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.685924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.686046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.686151] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a already deleted. [ 886.686262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.698438] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 886.725774] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.725922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.725993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.726232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.726431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.735705] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: IN_PROGRESS for 2s [ 886.836021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.836021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.836194] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.836346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.856666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.856922] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.857085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.857166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.857377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.857465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.857555] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3669143c-24cd-4014-976c-a88fbc9ce9be is going to be updated. [ 886.902537] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.902723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.902807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.903145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.903224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.913961] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3669143c-24cd-4014-976c-a88fbc9ce9be in Status: IN_PROGRESS for 2s [ 887.053480] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.053682] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.053793] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.054205] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.054396] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.054553] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.054669] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.058368] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.058599] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.058828] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.058947] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.059072] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.059188] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.059310] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.059476] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.059623] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.083442] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.083636] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 887.083846] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.084084] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.084731] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.084731] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.084946] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.085112] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.085278] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65bf542e-bff4-4d81-b0b1-89f59a3ceb2b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.588082] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.588399] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.588575] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.591834] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.592065] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.592249] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 65bf542e-bff4-4d81-b0b1-89f59a3ceb2b not found, creating... [ 887.592544] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.592710] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.592827] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.593102] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.593242] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.593537] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.593970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.594174] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.594757] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.594757] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.594757] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 65bf542e-bff4-4d81-b0b1-89f59a3ceb2b is going to be created. [ 887.617594] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.617817] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.617939] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.618438] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.618671] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.618896] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.685257] env[69756]: INFO networking_nsxv3.common.synchronization [req-c50c818d-fc82-42ad-a765-e24f226ab574 req-8160b3c1-7d9c-4dfd-803c-dc001e55aece service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 888.686348] env[69756]: INFO networking_nsxv3.common.synchronization [req-c50c818d-fc82-42ad-a765-e24f226ab574 req-8160b3c1-7d9c-4dfd-803c-dc001e55aece service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 888.686348] env[69756]: INFO networking_nsxv3.common.synchronization [req-c50c818d-fc82-42ad-a765-e24f226ab574 req-8160b3c1-7d9c-4dfd-803c-dc001e55aece service nova] Enqueued Resource ID: 65bf542e-bff4-4d81-b0b1-89f59a3ceb2b with Priority: HIGHEST for action port [ 888.686348] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 888.686348] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 888.686348] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bf542e-bff4-4d81-b0b1-89f59a3ceb2b with Priority: HIGHEST for action port [ 888.686667] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.686796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.686796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.687478] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.687478] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.688154] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.688290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.688947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.688947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.688947] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.688947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.688947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.689246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.689246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.689246] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.690534] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.690534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.690534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.690534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.690534] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65bf542e-bff4-4d81-b0b1-89f59a3ceb2b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.715931] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 888.716174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.747577] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: SUCCESS [ 888.747755] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca deletion is rescheduled due to dependency. [ 888.747939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.748088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.748470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.748470] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.749790] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6da5233-f6f0-4d61-a296-915a5edc7cca taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.749790] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.749790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.750404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.750404] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.751095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.751264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.751409] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.751516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.751597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.751713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.751858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.751858] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.926022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3669143c-24cd-4014-976c-a88fbc9ce9be in Status: SUCCESS [ 888.926222] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3669143c-24cd-4014-976c-a88fbc9ce9be deletion is rescheduled due to dependency. [ 888.926342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3669143c-24cd-4014-976c-a88fbc9ce9be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.192251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.192251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.196333] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.196333] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65bf542e-bff4-4d81-b0b1-89f59a3ceb2b with status ACTIVE [ 889.196333] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.196333] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.196333] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.196333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.196911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.196911] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65bf542e-bff4-4d81-b0b1-89f59a3ceb2b is going to be updated. [ 889.233313] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.233313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.233313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.233313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.233313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.233313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65bf542e-bff4-4d81-b0b1-89f59a3ceb2b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.253230] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6da5233-f6f0-4d61-a296-915a5edc7cca: rpc.has_security_group_logging(os_id): False [ 889.256282] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.256640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.256841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.257251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.259415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.259415] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.259415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.259415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.259415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.259415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.259415] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca is going to be updated. [ 889.278027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.278027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.278027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.278027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.278706] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.280517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.280517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.280517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.280517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.280517] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca is going to be updated. [ 889.286766] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.289150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.289150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.289150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.289150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.297587] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: IN_PROGRESS for 2s [ 889.369787] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.369787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.369787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.369787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.369787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.394549] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: IN_PROGRESS for 2s [ 889.705647] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.043377] env[69756]: INFO networking_nsxv3.common.synchronization [None req-812f62a1-e595-4fc0-b8a9-e14182285476 None None] Enqueued Resource ID: ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa with Priority: HIGHEST for action port [ 890.043377] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa with Priority: HIGHEST for action port [ 890.045294] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.045672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.045991] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.046576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.046787] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.209554] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.209554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.209554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.209554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.209554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.209554] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be created. [ 890.247831] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.247831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.247831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.247831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.247831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.256199] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: UNINITIALIZED for 2s [ 890.393784] env[69756]: INFO networking_nsxv3.common.synchronization [req-5a0e337c-6d58-42a6-b557-21ceebc581f4 req-0f77c79f-4ff9-4877-a530-896e588f55ac tempest-FloatingIPsAssociationNegativeTestJSON-147895576 tempest-FloatingIPsAssociationNegativeTestJSON-147895576-project-member] Enqueued Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGHEST for action security_group_members [ 890.394325] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGHEST for action security_group_members [ 890.394622] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.394741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.394810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.395183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.395349] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.395453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.395516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.395671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.395755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.395847] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa06de64-a891-4a6e-b4a0-eb1e3a875e9e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.550786] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa [ 890.551182] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.557018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.557018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.557018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.557018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.557018] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa already deleted. [ 890.557018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebc3a1b1-26bc-4faf-bc4c-afbddebc81aa" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.898788] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.899057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.900060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.900060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.928538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.928795] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.928908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.928977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.929204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.929282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.929523] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e is going to be updated. [ 890.966202] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.966202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.966202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.966202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.966202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.977754] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e in Status: IN_PROGRESS for 2s [ 891.310291] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: SUCCESS [ 891.310291] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca deletion is rescheduled due to dependency. [ 891.310435] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.344531] env[69756]: INFO networking_nsxv3.common.synchronization [req-82e6492c-619a-48cc-a5a8-d3f60d9ce429 req-a782a363-ee36-49af-b935-583596dd3816 tempest-ListImageFiltersTestJSON-1966339438 tempest-ListImageFiltersTestJSON-1966339438-project-member] Enqueued Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 891.345096] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 891.345417] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.345550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.345618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.345889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.350754] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.350925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.350925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.351980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.351980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.351980] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.409575] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6da5233-f6f0-4d61-a296-915a5edc7cca in Status: SUCCESS [ 891.409755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.409951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.410236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.410337] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6da5233-f6f0-4d61-a296-915a5edc7cca',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.854968] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.854968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.854968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.854968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.854968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.854968] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.855280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.855280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.855280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.855391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.855448] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 already deleted. [ 891.855507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.916131] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.916518] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.916518] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.917251] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.917251] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.918102] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.918102] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.918102] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.918102] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.918102] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.918278] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.918933] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.918933] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.918933] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.918933] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.919085] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.940308] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.940468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.940565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.940759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.940855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.940951] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6da5233-f6f0-4d61-a296-915a5edc7cca is going to be deleted. [ 891.942867] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.943623] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.943623] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.943623] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.943833] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-de1bcda7-9f17-4213-8691-0fd711ae9f9f taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.944053] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-de1bcda7-9f17-4213-8691-0fd711ae9f9f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.944217] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-de1bcda7-9f17-4213-8691-0fd711ae9f9f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.944551] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-de1bcda7-9f17-4213-8691-0fd711ae9f9f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.944725] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de1bcda7-9f17-4213-8691-0fd711ae9f9f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.996968] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.997254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.997328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.997541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.997633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.997759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6da5233-f6f0-4d61-a296-915a5edc7cca" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.272307] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 892.274490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.274490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.274490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.274490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.274490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.274490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.274490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.274490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.274490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.274490] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.448658] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.449018] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.449170] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.449495] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.449663] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.449819] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port de1bcda7-9f17-4213-8691-0fd711ae9f9f not found, creating... [ 892.450143] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.450305] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.450416] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.450644] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.450775] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.451315] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.451557] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.451709] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.451987] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.452242] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.452434] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: de1bcda7-9f17-4213-8691-0fd711ae9f9f is going to be created. [ 892.475232] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.475403] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.475536] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.475822] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.476240] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.476310] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-de1bcda7-9f17-4213-8691-0fd711ae9f9f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.779303] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.779539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.779579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.779766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.779929] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.780037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.780097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.780250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.780340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.780428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.780635] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.780736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.780736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.780847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.780977] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.781079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.781140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.781275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.781348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.781426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.781539] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.991160] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e in Status: SUCCESS [ 892.991488] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e deletion is rescheduled due to dependency. [ 892.991488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.075335] env[69756]: INFO networking_nsxv3.common.synchronization [None req-16b37fea-d347-4dce-ace4-83bc80b452fa None None] Enqueued Resource ID: e8668ec3-3de1-4305-a1b8-c41a910e7cad with Priority: HIGHEST for action port [ 893.075946] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8668ec3-3de1-4305-a1b8-c41a910e7cad with Priority: HIGHEST for action port [ 893.076285] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8668ec3-3de1-4305-a1b8-c41a910e7cad taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.076436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8668ec3-3de1-4305-a1b8-c41a910e7cad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.076505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8668ec3-3de1-4305-a1b8-c41a910e7cad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.076785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8668ec3-3de1-4305-a1b8-c41a910e7cad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.076868] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8668ec3-3de1-4305-a1b8-c41a910e7cad',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.141232] env[69756]: INFO networking_nsxv3.common.synchronization [req-6cfe2817-5f9c-4667-b7e3-ff4059ff8db4 req-db9a670a-4fc2-430a-b665-e49665f021ff tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 893.142401] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 893.142401] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.142538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.142538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.142679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.142828] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.142923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.142985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.147032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.147032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.147032] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.286675] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48c09f21-41e5-4def-8d66-8a36711be55a: rpc.has_security_group_logging(os_id): False [ 893.309527] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.309709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.309759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.310061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.310220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.310507] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.310618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.310684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.310847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.310931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.311143] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.311243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.311304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.311468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.311516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.311692] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.311783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.311845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.311983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.312258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.312355] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be created. [ 893.398439] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.398636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.398733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.399083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.399345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.415266] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 893.515168] env[69756]: INFO networking_nsxv3.common.synchronization [req-82e6492c-619a-48cc-a5a8-d3f60d9ce429 req-c086fe4a-4b7c-4a48-84df-e5270af0c050 service nova] Enqueued Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_rules [ 893.515168] env[69756]: INFO networking_nsxv3.common.synchronization [req-82e6492c-619a-48cc-a5a8-d3f60d9ce429 req-c086fe4a-4b7c-4a48-84df-e5270af0c050 service nova] Enqueued Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 893.515168] env[69756]: INFO networking_nsxv3.common.synchronization [req-82e6492c-619a-48cc-a5a8-d3f60d9ce429 req-c086fe4a-4b7c-4a48-84df-e5270af0c050 service nova] Enqueued Resource ID: de1bcda7-9f17-4213-8691-0fd711ae9f9f with Priority: HIGHEST for action port [ 893.515168] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_rules [ 893.515168] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 893.515168] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de1bcda7-9f17-4213-8691-0fd711ae9f9f with Priority: HIGHEST for action port [ 893.515168] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.515168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.515168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.515168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.515791] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.516602] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.516789] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.516865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.517143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.517353] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.517488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.517572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.517765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.517877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.517998] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.519033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-de1bcda7-9f17-4213-8691-0fd711ae9f9f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.519170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de1bcda7-9f17-4213-8691-0fd711ae9f9f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.519257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de1bcda7-9f17-4213-8691-0fd711ae9f9f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.519465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de1bcda7-9f17-4213-8691-0fd711ae9f9f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.519612] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de1bcda7-9f17-4213-8691-0fd711ae9f9f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.580327] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8668ec3-3de1-4305-a1b8-c41a910e7cad [ 893.580692] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.580692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.580830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.582042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.582042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.582042] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8668ec3-3de1-4305-a1b8-c41a910e7cad already deleted. [ 893.582042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8668ec3-3de1-4305-a1b8-c41a910e7cad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.647798] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.649426] env[69756]: INFO networking_nsxv3.common.synchronization [None req-9f2fb3cf-9134-4f5f-9cff-122a9ae60677 tempest-ImagesOneServerNegativeTestJSON-724061913 tempest-ImagesOneServerNegativeTestJSON-724061913-project-member] Enqueued Resource ID: ff0114b0-135c-4578-a681-25238643807a with Priority: HIGHEST for action security_group_rules [ 893.650083] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff0114b0-135c-4578-a681-25238643807a with Priority: HIGHEST for action security_group_rules [ 893.650380] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff0114b0-135c-4578-a681-25238643807a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.650497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff0114b0-135c-4578-a681-25238643807a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.650567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff0114b0-135c-4578-a681-25238643807a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.650823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff0114b0-135c-4578-a681-25238643807a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.650935] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff0114b0-135c-4578-a681-25238643807a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.760216] env[69756]: INFO networking_nsxv3.common.synchronization [None req-588ccf60-5631-41b9-8dc7-00f476aea69e tempest-ImagesOneServerNegativeTestJSON-724061913 tempest-ImagesOneServerNegativeTestJSON-724061913-project-member] Enqueued Resource ID: ff0114b0-135c-4578-a681-25238643807a with Priority: HIGHEST for action security_group_rules [ 893.760631] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff0114b0-135c-4578-a681-25238643807a with Priority: HIGHEST for action security_group_rules [ 893.760906] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff0114b0-135c-4578-a681-25238643807a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.761020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff0114b0-135c-4578-a681-25238643807a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.022198] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.022502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.022538] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de1bcda7-9f17-4213-8691-0fd711ae9f9f with status ACTIVE [ 894.023275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.023275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.023275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.023275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.023275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.023549] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.023549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.023549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.023680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.023757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.023931] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.024033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.024096] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.024238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.024312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.024395] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de1bcda7-9f17-4213-8691-0fd711ae9f9f is going to be updated. [ 894.025508] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.047115] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.047284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.047322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.047519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.047651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.047818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de1bcda7-9f17-4213-8691-0fd711ae9f9f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.150433] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.178663] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.178801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.178871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.179109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.179250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.179316] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff0114b0-135c-4578-a681-25238643807a already deleted. [ 894.183262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff0114b0-135c-4578-a681-25238643807a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.183262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff0114b0-135c-4578-a681-25238643807a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.183262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff0114b0-135c-4578-a681-25238643807a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.183262] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff0114b0-135c-4578-a681-25238643807a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.527678] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.653099] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.653420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.653571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.655926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.655926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.655926] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 894.684639] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.685215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.685678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.687345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.687345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.697798] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 894.701377] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.701377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.701377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.701377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.701377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.701377] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff0114b0-135c-4578-a681-25238643807a already deleted. [ 894.701377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff0114b0-135c-4578-a681-25238643807a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.815062] env[69756]: INFO networking_nsxv3.common.synchronization [None req-def7607c-f0e9-4418-906a-ba1139b36a38 None None] Enqueued Resource ID: ab9df656-d62f-4319-9e3e-73537fc5466f with Priority: HIGHEST for action port [ 894.815729] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9df656-d62f-4319-9e3e-73537fc5466f with Priority: HIGHEST for action port [ 894.816161] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab9df656-d62f-4319-9e3e-73537fc5466f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.816431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab9df656-d62f-4319-9e3e-73537fc5466f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.816584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab9df656-d62f-4319-9e3e-73537fc5466f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.816911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab9df656-d62f-4319-9e3e-73537fc5466f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.817179] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab9df656-d62f-4319-9e3e-73537fc5466f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.030642] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.030931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.030931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.031146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.031256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.031355] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 is going to be created. [ 895.062614] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.062775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.062814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.063038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.063192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.074691] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: UNINITIALIZED for 2s [ 895.321547] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab9df656-d62f-4319-9e3e-73537fc5466f [ 895.321547] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.321547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.321547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.321547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.321547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.321547] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab9df656-d62f-4319-9e3e-73537fc5466f already deleted. [ 895.321547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab9df656-d62f-4319-9e3e-73537fc5466f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.436245] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 895.436245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.639032] env[69756]: INFO networking_nsxv3.common.synchronization [None req-98484835-053f-49b2-b9d1-933f13d60f0a tempest-ServersTestFqdnHostnames-1788494129 tempest-ServersTestFqdnHostnames-1788494129-project-member] Enqueued Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_rules [ 895.639435] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_rules [ 895.639735] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.639857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.640859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.640859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.640859] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.739161] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8a8e05e6-918d-427c-bb12-04be5b4024da tempest-ServersTestFqdnHostnames-1788494129 tempest-ServersTestFqdnHostnames-1788494129-project-member] Enqueued Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_rules [ 895.739691] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_rules [ 895.740008] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.740119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.160344] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.160615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.160615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.160742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.160828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.160919] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 already deleted. [ 896.161000] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.161173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.161321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.161400] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.687401] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.687538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.687622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.688121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.688121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.688121] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 already deleted. [ 896.688121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.707168] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 896.707397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.085227] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: SUCCESS [ 897.085447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.085633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.085851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.086055] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.088170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.088170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.088170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.088170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.088170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.088170] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.112051] env[69756]: INFO networking_nsxv3.common.synchronization [None req-579d1f4f-c68d-422c-8189-fe3a3b7f2cfa None None] Enqueued Resource ID: 26910561-1a5c-44ab-a223-028385e3f7b5 with Priority: HIGHEST for action port [ 897.112294] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26910561-1a5c-44ab-a223-028385e3f7b5 with Priority: HIGHEST for action port [ 897.112860] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-26910561-1a5c-44ab-a223-028385e3f7b5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.112932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26910561-1a5c-44ab-a223-028385e3f7b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.112995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26910561-1a5c-44ab-a223-028385e3f7b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.113265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26910561-1a5c-44ab-a223-028385e3f7b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.113346] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26910561-1a5c-44ab-a223-028385e3f7b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.593834] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.594117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.594117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.594305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.594584] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.594584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.594732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.594831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.594875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.594931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.595109] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.595269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.595905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.597022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.597022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.597022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.597022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.597022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.597022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.597022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.597022] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.616348] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26910561-1a5c-44ab-a223-028385e3f7b5 [ 897.616560] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.616709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.616752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.616950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.617049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.617144] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26910561-1a5c-44ab-a223-028385e3f7b5 already deleted. [ 897.617247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26910561-1a5c-44ab-a223-028385e3f7b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.100025] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32e225ab-ea84-40a3-8d3c-daef53bb88e8: rpc.has_security_group_logging(os_id): False [ 898.119375] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.119520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.119601] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.119792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.119882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.120080] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.120184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.120235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.120393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.120465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.120656] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.120744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.120829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.120936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.121031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.121197] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.121290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.121348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.121484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.121553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.121634] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 is going to be created. [ 898.186055] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.186055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.186277] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.186575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.186790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.217639] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: IN_PROGRESS for 2s [ 898.673568] env[69756]: INFO networking_nsxv3.common.synchronization [req-254ebdbb-1c79-4f91-8f78-5b45f15fc489 req-0f9e3258-5125-4b61-b085-c3d747b09945 tempest-ListImageFiltersTestJSON-1966339438 tempest-ListImageFiltersTestJSON-1966339438-project-member] Enqueued Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 898.673844] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 898.673988] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.674139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.674206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.674503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.674859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.674859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.675018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.675086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.675147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.675334] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.133635] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.133771] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.133875] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.134726] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.134726] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.134726] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.134884] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.134988] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.136061] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.136751] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.136751] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.136751] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.136957] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.137141] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.138116] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.138116] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.158791] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.161750] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.161750] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.161750] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.161750] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-a2c5e672-e840-41b7-8bfe-fdab26f7a913 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.161750] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-a2c5e672-e840-41b7-8bfe-fdab26f7a913" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.161750] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-a2c5e672-e840-41b7-8bfe-fdab26f7a913" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.161750] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-a2c5e672-e840-41b7-8bfe-fdab26f7a913" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.161750] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2c5e672-e840-41b7-8bfe-fdab26f7a913',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.178460] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.667403] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.668052] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.668052] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.668052] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.668214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.668347] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port a2c5e672-e840-41b7-8bfe-fdab26f7a913 not found, creating... [ 899.668605] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.668754] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.668876] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.669107] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.669275] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.669558] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.669812] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.669995] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.670238] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.670376] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.670518] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: a2c5e672-e840-41b7-8bfe-fdab26f7a913 is going to be created. [ 899.680274] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.691735] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.692087] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.692549] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.692658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.692890] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.693163] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-a2c5e672-e840-41b7-8bfe-fdab26f7a913" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.182713] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.182954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.182954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.183180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.183278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.183382] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 is going to be updated. [ 900.236229] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.236583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.236583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.236689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.237405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.239194] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: SUCCESS [ 900.239194] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.251788] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: IN_PROGRESS for 2s [ 900.715312] env[69756]: INFO networking_nsxv3.common.synchronization [req-254ebdbb-1c79-4f91-8f78-5b45f15fc489 req-b7b60a44-f7ef-4f2e-8f4d-1c1906de4f4f service nova] Enqueued Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_rules [ 900.715312] env[69756]: INFO networking_nsxv3.common.synchronization [req-254ebdbb-1c79-4f91-8f78-5b45f15fc489 req-b7b60a44-f7ef-4f2e-8f4d-1c1906de4f4f service nova] Enqueued Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 900.715312] env[69756]: INFO networking_nsxv3.common.synchronization [req-254ebdbb-1c79-4f91-8f78-5b45f15fc489 req-b7b60a44-f7ef-4f2e-8f4d-1c1906de4f4f service nova] Enqueued Resource ID: a2c5e672-e840-41b7-8bfe-fdab26f7a913 with Priority: HIGHEST for action port [ 900.715312] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_rules [ 900.715312] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 900.715312] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c5e672-e840-41b7-8bfe-fdab26f7a913 with Priority: HIGHEST for action port [ 900.715312] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.715312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.715312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.715312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.715312] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.716553] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.716652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.717567] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2c5e672-e840-41b7-8bfe-fdab26f7a913 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.717698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2c5e672-e840-41b7-8bfe-fdab26f7a913" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.717766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2c5e672-e840-41b7-8bfe-fdab26f7a913" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.717971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2c5e672-e840-41b7-8bfe-fdab26f7a913" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.718104] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2c5e672-e840-41b7-8bfe-fdab26f7a913',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.217859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.217859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.223746] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2c5e672-e840-41b7-8bfe-fdab26f7a913 with status ACTIVE [ 901.223746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.223746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.223746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.223746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.223746] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2c5e672-e840-41b7-8bfe-fdab26f7a913 is going to be updated. [ 901.250208] env[69756]: INFO networking_nsxv3.common.synchronization [None req-65cf031e-49db-4cff-be39-075536eab5b4 None None] Enqueued Resource ID: 5b025127-d001-4934-994e-b70d815f27bd with Priority: HIGHEST for action port [ 901.251447] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.252627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.252627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.254085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.254085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.254085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2c5e672-e840-41b7-8bfe-fdab26f7a913" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.254085] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b025127-d001-4934-994e-b70d815f27bd with Priority: HIGHEST for action port [ 901.254656] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b025127-d001-4934-994e-b70d815f27bd taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.254936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b025127-d001-4934-994e-b70d815f27bd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.254936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b025127-d001-4934-994e-b70d815f27bd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.255433] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b025127-d001-4934-994e-b70d815f27bd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.255559] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b025127-d001-4934-994e-b70d815f27bd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.316348] env[69756]: INFO networking_nsxv3.common.synchronization [req-36b6543c-743f-436c-acef-34202b8f5c3c req-398eabcf-5f53-4d54-8386-ef1595283309 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 901.317423] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 901.317423] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.317659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.317659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.317785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.317947] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.319203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.319302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.319508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.319795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.319795] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.762247] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b025127-d001-4934-994e-b70d815f27bd [ 901.762522] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.762742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.762742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.762904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.762983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.763154] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b025127-d001-4934-994e-b70d815f27bd already deleted. [ 901.763295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b025127-d001-4934-994e-b70d815f27bd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.822195] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.263653] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: SUCCESS [ 902.263653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.263653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.263653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.263653] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.263653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.263653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.263906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.263906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.263906] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.303276] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.303276] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-524" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.303276] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-524" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.303276] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-524" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.303518] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.303518] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.303637] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.303772] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.303911] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.304131] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.304244] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.304350] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.304468] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.304562] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.304739] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.304779] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.324993] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.335070] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.335667] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 902.335667] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.335667] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-524" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.336027] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-01310128-8727-4517-b6d3-f7717b414b0e taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.336161] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.336224] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.336552] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.336728] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01310128-8727-4517-b6d3-f7717b414b0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.770663] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.828217] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.828217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.828217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.828560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.828560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.828560] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 902.839981] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.840076] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.840159] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.840446] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.840609] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.840729] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 01310128-8727-4517-b6d3-f7717b414b0e not found, creating... [ 902.840964] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.841137] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.841248] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.841459] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.841594] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.841934] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.842124] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.842247] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.842460] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.842597] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.842739] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 01310128-8727-4517-b6d3-f7717b414b0e is going to be created. [ 902.863734] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.864065] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.864221] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.864589] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.864928] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.865249] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.868598] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.868790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.868864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.869040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.869164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.883069] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 902.978595] env[69756]: INFO networking_nsxv3.common.synchronization [None req-1512c04d-5f10-4efe-9fc0-340b5bf4468c tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_rules [ 902.979417] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_rules [ 902.979857] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.980040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.980125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.980653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.980793] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.092385] env[69756]: INFO networking_nsxv3.common.synchronization [None req-d7341606-a842-4580-a6c8-d7eaa0f4b146 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_rules [ 903.092899] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_rules [ 903.093346] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.093462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.273447] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.503196] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.503196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.503196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.503381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.503381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.503440] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17111ea1-decc-4289-b6f5-8ab312a62032 already deleted. [ 903.503520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.503653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.503924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.504038] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.528867] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b88aef9c-4461-4c79-aded-9e6ae61c0796 None None] Enqueued Resource ID: 04aed082-e929-4f92-94c1-8ce69874c5d0 with Priority: HIGHEST for action port [ 903.529986] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04aed082-e929-4f92-94c1-8ce69874c5d0 with Priority: HIGHEST for action port [ 903.530325] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-04aed082-e929-4f92-94c1-8ce69874c5d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.533089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04aed082-e929-4f92-94c1-8ce69874c5d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.533089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04aed082-e929-4f92-94c1-8ce69874c5d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.533089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04aed082-e929-4f92-94c1-8ce69874c5d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.533089] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04aed082-e929-4f92-94c1-8ce69874c5d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.776904] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.777467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.777467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.777467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.777653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.777653] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 is going to be updated. [ 903.809766] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.809953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.810070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.810356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.810516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.820956] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: IN_PROGRESS for 2s [ 903.890536] env[69756]: INFO networking_nsxv3.common.synchronization [req-36b6543c-743f-436c-acef-34202b8f5c3c req-64dc4b34-457a-436e-81e8-8ab54b23a7ce service nova] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 903.890645] env[69756]: INFO networking_nsxv3.common.synchronization [req-36b6543c-743f-436c-acef-34202b8f5c3c req-64dc4b34-457a-436e-81e8-8ab54b23a7ce service nova] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 903.890791] env[69756]: INFO networking_nsxv3.common.synchronization [req-36b6543c-743f-436c-acef-34202b8f5c3c req-64dc4b34-457a-436e-81e8-8ab54b23a7ce service nova] Enqueued Resource ID: 01310128-8727-4517-b6d3-f7717b414b0e with Priority: HIGHEST for action port [ 903.891321] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 903.891508] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 903.891564] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01310128-8727-4517-b6d3-f7717b414b0e with Priority: HIGHEST for action port [ 903.891818] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.891940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.892014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.893095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.893178] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.894432] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.894779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.895188] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-01310128-8727-4517-b6d3-f7717b414b0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.895188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.895332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.895489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.895612] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01310128-8727-4517-b6d3-f7717b414b0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.026251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.026251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.026251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.026251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.026251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.026251] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17111ea1-decc-4289-b6f5-8ab312a62032 already deleted. [ 904.026251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.035020] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04aed082-e929-4f92-94c1-8ce69874c5d0 [ 904.035020] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.035020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.035020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.035020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.035020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.035020] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04aed082-e929-4f92-94c1-8ce69874c5d0 already deleted. [ 904.035020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04aed082-e929-4f92-94c1-8ce69874c5d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.063552] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bffff01-1004-44d6-8b98-c177cb459d41 req-fec6f213-1025-4430-bd3d-f33bcb0a099f tempest-ServersTestManualDisk-175454458 tempest-ServersTestManualDisk-175454458-project-member] Enqueued Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_members [ 904.063664] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_members [ 904.064771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6688165-9289-4b4f-a688-1379d300b9cd taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.064771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.064771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.064771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.064771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.065278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.065278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.065278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.065278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.065278] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.400185] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.400185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.400185] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01310128-8727-4517-b6d3-f7717b414b0e with status ACTIVE [ 904.400185] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.400185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.400185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.400185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.400185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.400185] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.400185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.400635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.400635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.400635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.400635] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.400752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.400752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.401079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.401144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.401192] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01310128-8727-4517-b6d3-f7717b414b0e is going to be updated. [ 904.423857] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.424074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.424177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.424426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.425319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.425319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.549870] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.550080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-484" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.550220] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-484" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.552337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-484" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.552337] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.552337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.552337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.552337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.552337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.552337] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.552337] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.552337] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.552337] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.552337] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.552337] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.552931] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.569903] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.569903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.569903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.569903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.570201] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.570201] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.570313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.570361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.570493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.570673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.570785] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6688165-9289-4b4f-a688-1379d300b9cd already deleted. [ 904.570862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.583243] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.583243] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 904.583243] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.583243] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-484" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.583243] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-155b124a-409c-4cb0-ac61-73ae1dbde431 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.583547] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-155b124a-409c-4cb0-ac61-73ae1dbde431" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.583547] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-155b124a-409c-4cb0-ac61-73ae1dbde431" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.583797] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-155b124a-409c-4cb0-ac61-73ae1dbde431" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.583937] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('155b124a-409c-4cb0-ac61-73ae1dbde431',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.897013] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 904.897403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.898030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.898030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.898030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.898263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.898263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.898445] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.898445] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.898528] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.087179] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.087774] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.087774] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.087893] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.088038] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.088207] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 155b124a-409c-4cb0-ac61-73ae1dbde431 not found, creating... [ 905.088485] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.088641] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.088760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.088984] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.089174] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.089408] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.089624] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.089811] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.090388] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.090481] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.090696] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 155b124a-409c-4cb0-ac61-73ae1dbde431 is going to be created. [ 905.112975] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.113333] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.113507] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.113798] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.114049] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.114390] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-155b124a-409c-4cb0-ac61-73ae1dbde431" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.400993] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.835031] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: SUCCESS [ 905.835031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.835031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.835031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.835031] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.835031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.835031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.835031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.835031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.835031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.835031] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.908135] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.959224] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bffff01-1004-44d6-8b98-c177cb459d41 req-8c39b264-bfb5-4867-8cd1-e984322f18cb service nova] Enqueued Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_rules [ 905.960536] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bffff01-1004-44d6-8b98-c177cb459d41 req-8c39b264-bfb5-4867-8cd1-e984322f18cb service nova] Enqueued Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_members [ 905.960536] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bffff01-1004-44d6-8b98-c177cb459d41 req-8c39b264-bfb5-4867-8cd1-e984322f18cb service nova] Enqueued Resource ID: 155b124a-409c-4cb0-ac61-73ae1dbde431 with Priority: HIGHEST for action port [ 905.960536] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_rules [ 905.960536] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_members [ 905.960536] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155b124a-409c-4cb0-ac61-73ae1dbde431 with Priority: HIGHEST for action port [ 905.961255] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6688165-9289-4b4f-a688-1379d300b9cd taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.961255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.961255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.961678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.961798] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.962789] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6688165-9289-4b4f-a688-1379d300b9cd taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.963257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.963458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.963694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.963913] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.964064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.964163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.964384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.964509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.964678] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.966126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-155b124a-409c-4cb0-ac61-73ae1dbde431 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.966336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-155b124a-409c-4cb0-ac61-73ae1dbde431" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.966459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-155b124a-409c-4cb0-ac61-73ae1dbde431" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.966657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-155b124a-409c-4cb0-ac61-73ae1dbde431" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.966799] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('155b124a-409c-4cb0-ac61-73ae1dbde431',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.337972] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.338081] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.338161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.338383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.338545] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.338657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.338713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.338852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.338943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.339052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.339200] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.339294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.339349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.339492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.339655] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.339755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.339815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.339957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.340044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.340127] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.340217] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.411171] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.411335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.411524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.411855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.412037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.412359] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 906.447831] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.448056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.448126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.448482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.448691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.463694] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 906.469114] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6688165-9289-4b4f-a688-1379d300b9cd taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.469114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.469114] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.470129] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 155b124a-409c-4cb0-ac61-73ae1dbde431 with status ACTIVE [ 906.470333] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.470458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.470526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.470741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.470837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.471136] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.472387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.472387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.472387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.472387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.472387] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.472387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.472387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.472387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.472750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.472750] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 155b124a-409c-4cb0-ac61-73ae1dbde431 is going to be updated. [ 906.494704] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.494892] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.494974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.495266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.495475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.495680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-155b124a-409c-4cb0-ac61-73ae1dbde431" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.845012] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32e225ab-ea84-40a3-8d3c-daef53bb88e8: rpc.has_security_group_logging(os_id): False [ 906.864235] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.864388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.864456] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.864679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.864770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.864976] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.865102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.865215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.865387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.865469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.865681] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.865811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.865875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.866031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.866109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.866292] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.866385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.866446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.866607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.866679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.866813] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 is going to be updated. [ 906.975527] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.996784] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.996978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.997027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.997230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.997517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.014172] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: IN_PROGRESS for 2s [ 907.478516] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.478516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.478516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.478723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.478723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.479929] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6688165-9289-4b4f-a688-1379d300b9cd is going to be created. [ 907.507812] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.507989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.508057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.508254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.508432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.523221] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6688165-9289-4b4f-a688-1379d300b9cd in Status: UNINITIALIZED for 2s [ 908.476626] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 908.476965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.479126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.479126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.479126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.479126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.479126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.479126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.479126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.479126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.479126] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.981498] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.981498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.981498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.981781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.981979] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.982106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.982199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.982425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.982916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.982916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.982916] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.982916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.983072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.983183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.983455] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.983590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.983590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.983730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.983844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.983941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.984052] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.032052] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: SUCCESS [ 909.032052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.487058] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85796156-67df-4d82-b494-0ea64303f9ba: rpc.has_security_group_logging(os_id): False [ 909.505891] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.506193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.506193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.506312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.526881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.527184] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.527306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.527388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.527612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.527697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.527894] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.527997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.528068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.528220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.528294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.528584] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.528729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.528817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.528995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.529089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.529179] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 909.532534] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6688165-9289-4b4f-a688-1379d300b9cd in Status: SUCCESS [ 909.532720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.532870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.533044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.533208] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.533308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.533372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.533518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.533593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.533675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.533777] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.589694] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.589694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.589694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.589929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.589975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.610090] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 910.036592] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.538889] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6688165-9289-4b4f-a688-1379d300b9cd: rpc.has_security_group_logging(os_id): False [ 910.560748] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.561026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.561026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.561342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.561463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.561769] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.561886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.561950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.562168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.562257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.562306] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6688165-9289-4b4f-a688-1379d300b9cd is going to be created. [ 910.638201] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.638375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.638429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.638677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.638860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.653622] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6688165-9289-4b4f-a688-1379d300b9cd in Status: IN_PROGRESS for 2s [ 910.961131] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 910.961257] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 911.627415] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 911.627808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.666868] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6688165-9289-4b4f-a688-1379d300b9cd in Status: SUCCESS [ 912.667206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.861242] env[69756]: INFO networking_nsxv3.common.synchronization [req-085c6e4d-341b-4663-ad91-c2a8314faf28 req-dbc0db03-d3a3-4237-82fd-70fd0d9c312b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 913.861519] env[69756]: INFO networking_nsxv3.common.synchronization [req-085c6e4d-341b-4663-ad91-c2a8314faf28 req-dbc0db03-d3a3-4237-82fd-70fd0d9c312b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 913.861987] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 913.862152] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 913.862368] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.862490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.862562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.862766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.862924] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.863025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.863090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.863236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.863323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.863414] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.864244] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c322b25-a3b6-44a5-97d5-969e45f1afbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.864352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.864420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.864666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.864797] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.864882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.864940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.865160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.865160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.865327] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.905604] env[69756]: INFO networking_nsxv3.common.synchronization [req-085c6e4d-341b-4663-ad91-c2a8314faf28 req-dbc0db03-d3a3-4237-82fd-70fd0d9c312b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_rules [ 913.905791] env[69756]: INFO networking_nsxv3.common.synchronization [req-085c6e4d-341b-4663-ad91-c2a8314faf28 req-dbc0db03-d3a3-4237-82fd-70fd0d9c312b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 913.905927] env[69756]: INFO networking_nsxv3.common.synchronization [req-085c6e4d-341b-4663-ad91-c2a8314faf28 req-dbc0db03-d3a3-4237-82fd-70fd0d9c312b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 913.906089] env[69756]: INFO networking_nsxv3.common.synchronization [req-085c6e4d-341b-4663-ad91-c2a8314faf28 req-dbc0db03-d3a3-4237-82fd-70fd0d9c312b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 913.906173] env[69756]: INFO networking_nsxv3.common.synchronization [req-085c6e4d-341b-4663-ad91-c2a8314faf28 req-dbc0db03-d3a3-4237-82fd-70fd0d9c312b tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 01310128-8727-4517-b6d3-f7717b414b0e with Priority: HIGHEST for action port [ 913.906670] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_rules [ 913.906806] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 913.906904] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01310128-8727-4517-b6d3-f7717b414b0e with Priority: HIGHEST for action port [ 913.906996] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 913.907750] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 913.908430] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.908562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.908631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.908886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.908968] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.910674] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.910823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.910897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.911103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.911185] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.913220] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-01310128-8727-4517-b6d3-f7717b414b0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.913341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.913619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.913619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.913778] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01310128-8727-4517-b6d3-f7717b414b0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.914359] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c322b25-a3b6-44a5-97d5-969e45f1afbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.914453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.914640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.914759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.367036] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.367933] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.411174] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c322b25-a3b6-44a5-97d5-969e45f1afbc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.411324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.416443] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.416559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.416750] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01310128-8727-4517-b6d3-f7717b414b0e with status ACTIVE [ 914.416909] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.417037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.417111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.417322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.417436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.417607] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.417708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.417771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.417933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.418019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.418201] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.418314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.418378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.418547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.418625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.418711] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01310128-8727-4517-b6d3-f7717b414b0e is going to be updated. [ 914.439385] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.439539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.439603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.439869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.440017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.440183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.869520] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.870876] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.379018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.379018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.379018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.379018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.379018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.379018] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 915.380271] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.380389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.380458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.380631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.380711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.380799] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc is going to be created. [ 915.408642] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.408807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.408862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.409086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.409251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.414163] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.414239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.414293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.415296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.415296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.422550] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc in Status: UNINITIALIZED for 2s [ 915.423317] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 917.073412] env[69756]: INFO networking_nsxv3.common.synchronization [req-d7f53df0-78ff-4562-8514-f8358909372e req-d08dc7e8-aeb6-49e2-a587-1d6627766cd2 tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_members [ 917.073957] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_members [ 917.074671] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5f631a6-10e1-4423-9d64-92e1be795a21 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.075434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.075434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.075434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.075434] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.075434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.075653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.075653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.075714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.075805] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.406388] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.406618] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.406766] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.407128] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.407406] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.407596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.407723] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.407959] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.410117] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.410380] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.410487] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.410602] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.410714] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.411281] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.411281] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.411281] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.444434] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 917.444684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.445260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.445527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.445717] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.445839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.445909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.446120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.446188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.446287] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.447956] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc in Status: SUCCESS [ 917.448150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.448603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.448603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.448734] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.448858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.448917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.449084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.449171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.449266] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.453697] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.453697] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.453912] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.454060] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.454627] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-ea59f5f8-b785-4a47-86ea-2412bdac610f taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.454824] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-ea59f5f8-b785-4a47-86ea-2412bdac610f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.454951] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-ea59f5f8-b785-4a47-86ea-2412bdac610f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.455307] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-ea59f5f8-b785-4a47-86ea-2412bdac610f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.455582] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea59f5f8-b785-4a47-86ea-2412bdac610f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.578909] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.579100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.579202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.579464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.579607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.579829] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.579983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.580074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.580261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.580341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.580427] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5f631a6-10e1-4423-9d64-92e1be795a21 already deleted. [ 917.580507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.755247] env[69756]: INFO networking_nsxv3.common.synchronization [req-9686376b-6c08-4997-84f7-6a6afe31200c req-011e3e7d-d016-4244-8418-19606565b90c tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 917.756492] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 917.756865] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.757413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.757552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.757814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.757971] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.758086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.758148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.758295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.758378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.758487] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.950962] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.951982] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.958080] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.958181] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.958372] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.958677] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.958829] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.959069] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port ea59f5f8-b785-4a47-86ea-2412bdac610f not found, creating... [ 917.959328] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.959445] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.959563] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.959836] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.959994] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.960296] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.960455] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.960575] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.960794] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.960932] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.962414] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: ea59f5f8-b785-4a47-86ea-2412bdac610f is going to be created. [ 917.992071] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.992973] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.992973] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.992973] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.992973] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.993187] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-ea59f5f8-b785-4a47-86ea-2412bdac610f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.260775] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.261131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.261131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.261340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.261416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.261617] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.261718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.261831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.262047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.262091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.262180] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 918.295306] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.295306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.295306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.296313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.296313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.304641] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 918.455019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.457077] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.823177] env[69756]: INFO networking_nsxv3.common.synchronization [req-d7f53df0-78ff-4562-8514-f8358909372e req-a0606a8f-5c95-49e6-ad73-c1baf24b8c3e service nova] Enqueued Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_rules [ 918.823832] env[69756]: INFO networking_nsxv3.common.synchronization [req-d7f53df0-78ff-4562-8514-f8358909372e req-a0606a8f-5c95-49e6-ad73-c1baf24b8c3e service nova] Enqueued Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_members [ 918.823832] env[69756]: INFO networking_nsxv3.common.synchronization [req-d7f53df0-78ff-4562-8514-f8358909372e req-a0606a8f-5c95-49e6-ad73-c1baf24b8c3e service nova] Enqueued Resource ID: ea59f5f8-b785-4a47-86ea-2412bdac610f with Priority: HIGHEST for action port [ 918.823832] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_rules [ 918.823951] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_members [ 918.823997] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea59f5f8-b785-4a47-86ea-2412bdac610f with Priority: HIGHEST for action port [ 918.827542] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5f631a6-10e1-4423-9d64-92e1be795a21 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.827542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.827542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.827542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.827542] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.827996] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5f631a6-10e1-4423-9d64-92e1be795a21 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.830569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.830569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.830569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.830869] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.830929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.832085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.832085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.832085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.832085] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.835442] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea59f5f8-b785-4a47-86ea-2412bdac610f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.836803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea59f5f8-b785-4a47-86ea-2412bdac610f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.836803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea59f5f8-b785-4a47-86ea-2412bdac610f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.836803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea59f5f8-b785-4a47-86ea-2412bdac610f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.836803] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea59f5f8-b785-4a47-86ea-2412bdac610f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.960025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.960208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.960282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.960569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.960715] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.960861] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc is going to be updated. [ 918.962294] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.962294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.962294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.963650] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.963813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.963919] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 919.000767] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.000986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.001068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.001615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.001615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.005180] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.005180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.005180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.005180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.005180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.018361] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc in Status: IN_PROGRESS for 2s [ 919.019267] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 919.294442] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: da1bfdae-baca-46b1-beae-bf1845d748b5 with Priority: HIGHEST for action security_group_members [ 919.294671] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 919.294764] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 919.295303] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1bfdae-baca-46b1-beae-bf1845d748b5 with Priority: HIGHEST for action security_group_members [ 919.295435] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 919.297155] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 919.297155] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1bfdae-baca-46b1-beae-bf1845d748b5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.297155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.297155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.297155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.297643] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.297643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.297643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.297763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.297817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.297955] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da1bfdae-baca-46b1-beae-bf1845d748b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.299087] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c322b25-a3b6-44a5-97d5-969e45f1afbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.299490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.299490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.299605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.339160] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.340472] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5f631a6-10e1-4423-9d64-92e1be795a21 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.340647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.341494] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea59f5f8-b785-4a47-86ea-2412bdac610f with status ACTIVE [ 919.341696] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.341814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.341883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.342229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.342327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.342505] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.342641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.342718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.342886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.342976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.343259] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.343559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.343559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.343655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.343727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.343867] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea59f5f8-b785-4a47-86ea-2412bdac610f is going to be updated. [ 919.347029] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_rules [ 919.347029] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 919.347029] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 919.347180] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 919.347313] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: da1bfdae-baca-46b1-beae-bf1845d748b5 with Priority: HIGHEST for action security_group_rules [ 919.347431] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: da1bfdae-baca-46b1-beae-bf1845d748b5 with Priority: HIGHEST for action security_group_members [ 919.347724] env[69756]: INFO networking_nsxv3.common.synchronization [req-acb97f59-8954-404e-a782-b1c8ff3029d4 req-fd42360a-8ef3-42d3-be6f-956f8a3a157c tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 01310128-8727-4517-b6d3-f7717b414b0e with Priority: HIGHEST for action port [ 919.348514] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_rules [ 919.348985] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_rules [ 919.348985] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1bfdae-baca-46b1-beae-bf1845d748b5 with Priority: HIGHEST for action security_group_members [ 919.349167] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01310128-8727-4517-b6d3-f7717b414b0e with Priority: HIGHEST for action port [ 919.349326] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1bfdae-baca-46b1-beae-bf1845d748b5 with Priority: HIGHEST for action security_group_rules [ 919.349483] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 919.349634] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 919.351699] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.351814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.352009] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.352101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.352419] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1bfdae-baca-46b1-beae-bf1845d748b5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.352507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.352949] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-01310128-8727-4517-b6d3-f7717b414b0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.352949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.352949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.353143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.353233] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01310128-8727-4517-b6d3-f7717b414b0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.354079] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da1bfdae-baca-46b1-beae-bf1845d748b5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.354221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.354315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.354526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.354603] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da1bfdae-baca-46b1-beae-bf1845d748b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.355378] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c322b25-a3b6-44a5-97d5-969e45f1afbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.356024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.356024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.356024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.373657] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.373657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.373657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.373657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.373657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.373657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea59f5f8-b785-4a47-86ea-2412bdac610f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.801217] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da1bfdae-baca-46b1-beae-bf1845d748b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.828573] env[69756]: INFO networking_nsxv3.common.synchronization [req-34fea13f-a378-4bc3-bb63-3f03711215b0 req-7e14de2e-3fa1-4deb-a351-f8f2becc16d5 tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 919.829261] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 919.829572] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.829702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.829813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.830252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.830424] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.830537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.830591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.830774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.830862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.830960] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.842353] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.857572] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1bfdae-baca-46b1-beae-bf1845d748b5 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.857731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.857950] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01310128-8727-4517-b6d3-f7717b414b0e with status ACTIVE [ 919.858065] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.858173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.858252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.858452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.858562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.858745] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.858872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.858906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.859064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.859146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.859322] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.859435] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.859468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.859605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.859724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.859753] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01310128-8727-4517-b6d3-f7717b414b0e is going to be updated. [ 919.883044] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.884057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.884186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.884478] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.884681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.884906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01310128-8727-4517-b6d3-f7717b414b0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.251216] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.251216] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.251216] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.251415] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.251647] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.251821] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.253464] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.253464] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.253464] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.253464] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.253464] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.253464] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.253464] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.253464] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.253464] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.253464] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.273901] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.276759] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.276759] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.276759] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.276759] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-6916db07-c476-49dd-a274-0f645179c771 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.276759] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-6916db07-c476-49dd-a274-0f645179c771" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.276759] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-6916db07-c476-49dd-a274-0f645179c771" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.276759] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-6916db07-c476-49dd-a274-0f645179c771" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.276759] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6916db07-c476-49dd-a274-0f645179c771',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.307743] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da1bfdae-baca-46b1-beae-bf1845d748b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.315476] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 920.315686] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a deletion is rescheduled due to dependency. [ 920.315803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.333399] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.333597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.333672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.333831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.333923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.334131] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.334231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.334295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.334443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.334519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.334636] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 already deleted. [ 920.334761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.344535] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.344714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.344787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.344970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.345068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.345163] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5f631a6-10e1-4423-9d64-92e1be795a21 is going to be created. [ 920.370131] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.370463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.370502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.370737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.370910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.382208] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5f631a6-10e1-4423-9d64-92e1be795a21 in Status: UNINITIALIZED for 2s [ 920.780972] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.781461] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.781703] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.782062] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.782318] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.782573] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 6916db07-c476-49dd-a274-0f645179c771 not found, creating... [ 920.783029] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.783217] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.783352] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.783646] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.783870] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.784359] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.784654] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.784817] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.785327] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.785404] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.785726] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 6916db07-c476-49dd-a274-0f645179c771 is going to be created. [ 920.810450] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.810639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.810742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.810987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.811101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.811868] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da1bfdae-baca-46b1-beae-bf1845d748b5 is going to be created. [ 920.838152] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.838289] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.838412] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.838727] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.839032] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.839344] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-6916db07-c476-49dd-a274-0f645179c771" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.846775] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.846957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.847090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.847346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.847588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.857825] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da1bfdae-baca-46b1-beae-bf1845d748b5 in Status: UNINITIALIZED for 2s [ 921.032081] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc in Status: SUCCESS [ 921.032406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.032655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.032944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.033215] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.033392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.033479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.033686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.033806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.033910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.034092] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.035908] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 921.036149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.036358] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.036621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.036871] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.037091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.037091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.037314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.037440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.037583] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.038450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.038651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.039320] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.039320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.039320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.039320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.039320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.039549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.039622] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.040981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.041132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.041286] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.041398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.041471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.041621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.041703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.041794] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.527405] env[69756]: INFO networking_nsxv3.common.synchronization [req-34fea13f-a378-4bc3-bb63-3f03711215b0 req-b52c69ae-53e8-4d0b-bd67-3d44012f4356 service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 921.527656] env[69756]: INFO networking_nsxv3.common.synchronization [req-34fea13f-a378-4bc3-bb63-3f03711215b0 req-b52c69ae-53e8-4d0b-bd67-3d44012f4356 service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 921.527767] env[69756]: INFO networking_nsxv3.common.synchronization [req-34fea13f-a378-4bc3-bb63-3f03711215b0 req-b52c69ae-53e8-4d0b-bd67-3d44012f4356 service nova] Enqueued Resource ID: 6916db07-c476-49dd-a274-0f645179c771 with Priority: HIGHEST for action port [ 921.532198] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 921.532348] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 921.532451] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6916db07-c476-49dd-a274-0f645179c771 with Priority: HIGHEST for action port [ 921.532754] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.532888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.532965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.533247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.533351] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.534278] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.534398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.534453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.534647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.535576] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.535722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.535800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.539031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.539031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.539031] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.539031] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-6916db07-c476-49dd-a274-0f645179c771 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.539031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6916db07-c476-49dd-a274-0f645179c771" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.539031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6916db07-c476-49dd-a274-0f645179c771" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.539031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6916db07-c476-49dd-a274-0f645179c771" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.539031] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6916db07-c476-49dd-a274-0f645179c771',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.541896] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.542722] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.544070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.544172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.544315] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.044020] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.044020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.044020] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6916db07-c476-49dd-a274-0f645179c771 with status ACTIVE [ 922.044020] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.044020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.044020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.044020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.044020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.044020] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.044020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.044020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.044020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.044020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.044020] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.044629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.044629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.044629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.044629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.044629] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6916db07-c476-49dd-a274-0f645179c771 is going to be updated. [ 922.047137] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.048395] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c322b25-a3b6-44a5-97d5-969e45f1afbc: rpc.has_security_group_logging(os_id): False [ 922.049361] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.050849] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.070054] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.070233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.070317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.070533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.070714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.070983] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.071102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.071178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.071352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.071434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.071521] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc is going to be created. [ 922.073777] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.073888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.074300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.074557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.074866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.074929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6916db07-c476-49dd-a274-0f645179c771" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.128160] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.128339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.128390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.128689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.128870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.142867] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc in Status: IN_PROGRESS for 2s [ 922.268766] env[69756]: INFO networking_nsxv3.common.synchronization [req-73486f9e-6350-41b0-998d-88123bccd0a6 req-b9e5dc1a-425b-49e6-a82e-4615d25e9737 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: da1bfdae-baca-46b1-beae-bf1845d748b5 with Priority: HIGHEST for action security_group_members [ 922.268766] env[69756]: INFO networking_nsxv3.common.synchronization [req-73486f9e-6350-41b0-998d-88123bccd0a6 req-b9e5dc1a-425b-49e6-a82e-4615d25e9737 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 922.268867] env[69756]: INFO networking_nsxv3.common.synchronization [req-73486f9e-6350-41b0-998d-88123bccd0a6 req-b9e5dc1a-425b-49e6-a82e-4615d25e9737 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 922.269468] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1bfdae-baca-46b1-beae-bf1845d748b5 with Priority: HIGHEST for action security_group_members [ 922.269628] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 922.269730] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc with Priority: HIGHEST for action security_group_members [ 922.270135] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1bfdae-baca-46b1-beae-bf1845d748b5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.270258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.270452] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.270535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.270711] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c322b25-a3b6-44a5-97d5-969e45f1afbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.270791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.402112] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5f631a6-10e1-4423-9d64-92e1be795a21 in Status: SUCCESS [ 922.402112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.402112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.402112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.402112] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.402112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.402112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.402112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.402112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.402112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.402802] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.552598] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.552877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.552877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.553158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.553254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.553371] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc is going to be updated. [ 922.554586] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.555702] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.555834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.555972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.556144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.556235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.556337] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 922.589297] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.589496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.589496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.589725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.589911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.592054] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.592258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.592334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.592673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.592882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.606888] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc in Status: IN_PROGRESS for 2s [ 922.607729] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 922.713785] env[69756]: INFO networking_nsxv3.common.synchronization [req-224abeae-c132-4936-a4a0-aeda762dedaf req-41662f7a-ed83-49b1-962b-dce3f1ffa276 tempest-ImagesOneServerTestJSON-77063127 tempest-ImagesOneServerTestJSON-77063127-project-member] Enqueued Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGHEST for action security_group_members [ 922.714352] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGHEST for action security_group_members [ 922.715146] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b44dcd-979b-48b6-b98c-52c13fee616a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.715284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.715346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.715692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.715882] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.716069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.716121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.716246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.716353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.716456] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0b44dcd-979b-48b6-b98c-52c13fee616a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.868685] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da1bfdae-baca-46b1-beae-bf1845d748b5 in Status: SUCCESS [ 922.868944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.869154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.869386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.871887] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.871887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.871887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.871887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.871887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.871887] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da1bfdae-baca-46b1-beae-bf1845d748b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.905503] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.061334] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.061334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.061334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.061334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.061334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.061334] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be created. [ 923.089188] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.089188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.089188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.089188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.089188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.103067] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: UNINITIALIZED for 2s [ 923.167512] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-508 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.167512] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-508" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.167512] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-508" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.167845] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-508" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.169429] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.169647] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.169776] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.170075] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.170241] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.171103] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 923.171264] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.171384] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.171499] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.171618] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 923.171727] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.171872] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.193525] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.193635] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 923.195184] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.195184] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-508" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.195184] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-78d250e7-82fd-4e18-a35f-db58dd4ede69 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.195184] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-78d250e7-82fd-4e18-a35f-db58dd4ede69" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.195184] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-78d250e7-82fd-4e18-a35f-db58dd4ede69" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.195184] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-78d250e7-82fd-4e18-a35f-db58dd4ede69" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.195184] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d250e7-82fd-4e18-a35f-db58dd4ede69',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.222356] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.222558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.222641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.222870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.222964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.223183] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.223316] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.223417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.223615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.223725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.223817] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0b44dcd-979b-48b6-b98c-52c13fee616a already deleted. [ 923.223905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.373909] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.374100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.374179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.374403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.374499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.374700] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.374800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.374861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.375024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.375106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.375197] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da1bfdae-baca-46b1-beae-bf1845d748b5 is going to be deleted. [ 923.408369] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5f631a6-10e1-4423-9d64-92e1be795a21: rpc.has_security_group_logging(os_id): False [ 923.423916] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.423916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.423916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.426026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.426026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.426026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.426026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.426026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.426026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.426880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.427203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.427636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.427953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.429570] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da1bfdae-baca-46b1-beae-bf1845d748b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.435130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.435130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.435130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.435130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.435130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.435130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.435130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.435130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.435130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.435130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.435130] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5f631a6-10e1-4423-9d64-92e1be795a21 is going to be created. [ 923.516406] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.516609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.516669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.516909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.517076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.537822] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5f631a6-10e1-4423-9d64-92e1be795a21 in Status: IN_PROGRESS for 2s [ 923.701022] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.701022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.701022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.701022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.701022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.701022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 78d250e7-82fd-4e18-a35f-db58dd4ede69 not found, creating... [ 923.701022] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.701022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.701022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.703659] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.703659] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.705500] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.707214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.707214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.707214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.707214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.707214] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 78d250e7-82fd-4e18-a35f-db58dd4ede69 is going to be created. [ 923.735437] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.735740] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.735891] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.736220] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.736539] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.736833] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-78d250e7-82fd-4e18-a35f-db58dd4ede69" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.931591] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.931591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.931591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.931965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.931965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.932033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.932099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.932186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.932326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.932409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.932494] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da1bfdae-baca-46b1-beae-bf1845d748b5 already deleted. [ 923.932575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.932769] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da1bfdae-baca-46b1-beae-bf1845d748b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.933560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.933731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.933877] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.933974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.934089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.934241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.934315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.934400] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da1bfdae-baca-46b1-beae-bf1845d748b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.157690] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc in Status: SUCCESS [ 924.157982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.158197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.158416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.158649] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.436890] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da1bfdae-baca-46b1-beae-bf1845d748b5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.437986] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.438132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.438191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.438807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.438807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.438807] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.438807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.439148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.439148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.439148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.439241] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da1bfdae-baca-46b1-beae-bf1845d748b5 already deleted. [ 924.439804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.479352] env[69756]: INFO networking_nsxv3.common.synchronization [req-224abeae-c132-4936-a4a0-aeda762dedaf req-38cd161d-0009-49cf-b17b-7072f70429bc service nova] Enqueued Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGHEST for action security_group_rules [ 924.479352] env[69756]: INFO networking_nsxv3.common.synchronization [req-224abeae-c132-4936-a4a0-aeda762dedaf req-38cd161d-0009-49cf-b17b-7072f70429bc service nova] Enqueued Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGHEST for action security_group_members [ 924.479352] env[69756]: INFO networking_nsxv3.common.synchronization [req-224abeae-c132-4936-a4a0-aeda762dedaf req-38cd161d-0009-49cf-b17b-7072f70429bc service nova] Enqueued Resource ID: 78d250e7-82fd-4e18-a35f-db58dd4ede69 with Priority: HIGHEST for action port [ 924.479352] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGHEST for action security_group_rules [ 924.479352] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGHEST for action security_group_members [ 924.479352] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d250e7-82fd-4e18-a35f-db58dd4ede69 with Priority: HIGHEST for action port [ 924.479352] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0b44dcd-979b-48b6-b98c-52c13fee616a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.479352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.479352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.479949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.480224] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0b44dcd-979b-48b6-b98c-52c13fee616a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.481636] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b44dcd-979b-48b6-b98c-52c13fee616a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.482021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.482188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.482539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.482791] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.482997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.483153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.483406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.483609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.483819] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0b44dcd-979b-48b6-b98c-52c13fee616a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.484711] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-78d250e7-82fd-4e18-a35f-db58dd4ede69 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.484946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78d250e7-82fd-4e18-a35f-db58dd4ede69" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.485114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78d250e7-82fd-4e18-a35f-db58dd4ede69" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.485364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78d250e7-82fd-4e18-a35f-db58dd4ede69" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.485534] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d250e7-82fd-4e18-a35f-db58dd4ede69',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.623143] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc in Status: SUCCESS [ 924.623359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.626239] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 924.626239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.626239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.626239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.626239] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.626239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.626239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.626239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.626239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.626239] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.626663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.626867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.627114] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.627114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.627240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.628026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.628026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.628026] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.682942] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.683145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.683205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.683403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.683553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.683805] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc is going to be deleted. [ 924.737516] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.737958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.737958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.738204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.738344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.738596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.941146] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da1bfdae-baca-46b1-beae-bf1845d748b5: rpc.has_security_group_logging(os_id): False [ 924.961404] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.962034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.962034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.962034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.962034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.962390] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.962390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.962390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.962511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.962606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.963331] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da1bfdae-baca-46b1-beae-bf1845d748b5 is going to be created. [ 924.984974] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/da1bfdae-baca-46b1-beae-bf1845d748b5], does not exist path=[/infra/domains/default/groups/da1bfdae-baca-46b1-beae-bf1845d748b5]."\n}' [ 924.986847] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da1bfdae-baca-46b1-beae-bf1845d748b5 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da1bfdae-baca-46b1-beae-bf1845d748b5 [ 924.986847] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 924.988706] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b44dcd-979b-48b6-b98c-52c13fee616a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.988850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.989073] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0b44dcd-979b-48b6-b98c-52c13fee616a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.990638] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78d250e7-82fd-4e18-a35f-db58dd4ede69 with status ACTIVE [ 924.990847] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.991307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.991307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.991307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.991425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.991525] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.991621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.991685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.991899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.991944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.992125] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.992239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.992300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.992472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.992512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.992588] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78d250e7-82fd-4e18-a35f-db58dd4ede69 is going to be updated. [ 925.016418] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.016576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.016676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.016965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.017164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.018296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78d250e7-82fd-4e18-a35f-db58dd4ede69" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.027824] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.027993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.032062] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.032062] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.032062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.032062] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da1bfdae-baca-46b1-beae-bf1845d748b5 is going to be created. [ 925.051192] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/da1bfdae-baca-46b1-beae-bf1845d748b5], does not exist path=[/infra/domains/default/groups/da1bfdae-baca-46b1-beae-bf1845d748b5]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da1bfdae-baca-46b1-beae-bf1845d748b5 [ 925.051390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da1bfdae-baca-46b1-beae-bf1845d748b5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.051650] env[69756]: Traceback (most recent call last): [ 925.051703] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 925.051703] env[69756]: return func(*args, **kwargs) [ 925.051703] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 925.051703] env[69756]: res.raise_for_status() [ 925.051703] env[69756]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 925.051703] env[69756]: raise HTTPError(http_error_msg, response=self) [ 925.051703] env[69756]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da1bfdae-baca-46b1-beae-bf1845d748b5 [ 925.051703] env[69756]: During handling of the above exception, another exception occurred: [ 925.051703] env[69756]: Traceback (most recent call last): [ 925.051934] env[69756]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 925.051934] env[69756]: listener.cb(fileno) [ 925.051934] env[69756]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 925.051934] env[69756]: result = function(*args, **kwargs) [ 925.051934] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 925.051934] env[69756]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 925.051934] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 925.051934] env[69756]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 925.051934] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 925.051934] env[69756]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 925.051934] env[69756]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 925.051934] env[69756]: res.raise_for_status() [ 925.051934] env[69756]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 925.051934] env[69756]: raise HTTPError(http_error_msg, response=self) [ 925.051934] env[69756]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da1bfdae-baca-46b1-beae-bf1845d748b5 [ 925.051934] env[69756]: Removing descriptor: 13 [ 925.119018] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 925.119741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.119741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.119741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.120073] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.120073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.120073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.120291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.120291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.120291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.120496] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.130043] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.130289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.130289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.130370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.130559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.130656] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.130735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.130801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.130927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.131010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.131103] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc is going to be deleted. [ 925.132153] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.183241] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.183375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.183444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.183653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.183760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.184683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.184683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.184683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.184683] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.184683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.184683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.184683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.184683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.185373] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c322b25-a3b6-44a5-97d5-969e45f1afbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.495849] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0b44dcd-979b-48b6-b98c-52c13fee616a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.551876] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5f631a6-10e1-4423-9d64-92e1be795a21 in Status: SUCCESS [ 925.552170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.567545] env[69756]: INFO networking_nsxv3.common.synchronization [req-7128d2a5-9b81-4f52-b7aa-b9a774ed87c5 req-cd37e1de-0919-4d7c-a8d5-104bb3b4553f tempest-ServerDiagnosticsTest-1841012087 tempest-ServerDiagnosticsTest-1841012087-project-member] Enqueued Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGHEST for action security_group_members [ 925.568245] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGHEST for action security_group_members [ 925.568637] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9269ab-57a3-474d-a98c-7ba1583e57fc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.568773] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.568855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.569210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.569413] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.569744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.569853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.570067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.570192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.570321] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d9269ab-57a3-474d-a98c-7ba1583e57fc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.624030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.624256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.624428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.624638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.624860] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.625039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.625174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.625379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.625530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.625935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.625935] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.626162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.626162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.626286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.626480] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.626550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.626616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.626805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.626957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.631624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.631677] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.634964] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.686939] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.687147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.687268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.687645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.687791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.688066] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.688227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.688336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.688611] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.688689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.688809] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c322b25-a3b6-44a5-97d5-969e45f1afbc already deleted. [ 925.688938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c322b25-a3b6-44a5-97d5-969e45f1afbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.001869] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.002173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.002173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.002368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.002463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.002577] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0b44dcd-979b-48b6-b98c-52c13fee616a is going to be created. [ 926.049466] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.050065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.050065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.050215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.050465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.065196] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0b44dcd-979b-48b6-b98c-52c13fee616a in Status: UNINITIALIZED for 2s [ 926.067322] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.067548] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.067717] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.071278] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.071621] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.071803] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.071924] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.072244] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.072672] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.072672] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.072782] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.072823] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.072932] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.073069] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.073167] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.073304] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.076331] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.076466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.076537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.076750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.076845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.077060] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.077164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.077227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.077392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.077469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.077563] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc already deleted. [ 926.077656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.099380] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.099560] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 926.099703] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.099986] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.100353] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.100536] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.100659] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.100998] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.101253] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01bb4391-1c0b-4003-9ef4-c3a33937a9d8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.134895] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d711ed5-98da-4810-9f03-9148ad645008: rpc.has_security_group_logging(os_id): False [ 926.137858] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.138136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.138279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.138544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.138731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.138907] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 926.155509] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.155725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.155768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.156764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.156764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.156764] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.156764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.156764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.156764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.156764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.157202] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.157202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.157202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.157202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.157337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.157415] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.157504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.157561] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.157736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.157806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.157890] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be created. [ 926.184533] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.184697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.184759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.184982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.185143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.204216] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 926.273637] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.273821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.273862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.274186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.274422] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.294094] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 926.603419] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.607023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.607023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.607023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.607023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.607023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 01bb4391-1c0b-4003-9ef4-c3a33937a9d8 not found, creating... [ 926.607023] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.607023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.607023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.607023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.607023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.607509] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.607509] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.607509] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.608186] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.608523] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.608830] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 01bb4391-1c0b-4003-9ef4-c3a33937a9d8 is going to be created. [ 926.630920] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.630920] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.630920] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.630920] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.630920] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.630920] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.670217] env[69756]: INFO networking_nsxv3.common.synchronization [req-7128d2a5-9b81-4f52-b7aa-b9a774ed87c5 req-7c5be879-8517-4b4b-970e-0bd2164f7263 service nova] Enqueued Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGHEST for action security_group_rules [ 927.670595] env[69756]: INFO networking_nsxv3.common.synchronization [req-7128d2a5-9b81-4f52-b7aa-b9a774ed87c5 req-7c5be879-8517-4b4b-970e-0bd2164f7263 service nova] Enqueued Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGHEST for action security_group_members [ 927.670595] env[69756]: INFO networking_nsxv3.common.synchronization [req-7128d2a5-9b81-4f52-b7aa-b9a774ed87c5 req-7c5be879-8517-4b4b-970e-0bd2164f7263 service nova] Enqueued Resource ID: 01bb4391-1c0b-4003-9ef4-c3a33937a9d8 with Priority: HIGHEST for action port [ 927.671245] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGHEST for action security_group_rules [ 927.671441] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGHEST for action security_group_members [ 927.671561] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01bb4391-1c0b-4003-9ef4-c3a33937a9d8 with Priority: HIGHEST for action port [ 927.671924] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.672216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.672739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.673065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.673249] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d9269ab-57a3-474d-a98c-7ba1583e57fc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.674649] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9269ab-57a3-474d-a98c-7ba1583e57fc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.674649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.674649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.674649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.674894] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.674941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.675069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.675192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.675304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.675420] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d9269ab-57a3-474d-a98c-7ba1583e57fc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.676393] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.676393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.676393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.676612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.676860] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01bb4391-1c0b-4003-9ef4-c3a33937a9d8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.075657] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0b44dcd-979b-48b6-b98c-52c13fee616a in Status: SUCCESS [ 928.075752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.075921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.076156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.076348] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.076463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.076530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.076679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.076762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.076846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.076938] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0b44dcd-979b-48b6-b98c-52c13fee616a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.179502] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9269ab-57a3-474d-a98c-7ba1583e57fc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.179640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.179834] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d9269ab-57a3-474d-a98c-7ba1583e57fc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.180939] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01bb4391-1c0b-4003-9ef4-c3a33937a9d8 with status ACTIVE [ 928.180939] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.181076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.181124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.181326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.181414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.181588] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.181679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.181739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.181889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.181968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.182548] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.182761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.182881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.183128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.183224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.183645] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01bb4391-1c0b-4003-9ef4-c3a33937a9d8 is going to be updated. [ 928.208993] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.209171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.209691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.209691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.209691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.209864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01bb4391-1c0b-4003-9ef4-c3a33937a9d8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.214330] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 928.214544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.214774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.215011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.215203] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.215977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.215977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.215977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.215977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.215977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.215977] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.215977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.215977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.216372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.216372] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.216372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.216475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.216754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.216754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.216754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.216841] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.218481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.218674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.219090] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.219204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.219272] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.219414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.219492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.219585] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.312117] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 928.313257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.582900] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b44dcd-979b-48b6-b98c-52c13fee616a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.582900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.582900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.582900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.582900] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.582900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.582900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.583263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.583263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.583263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.583263] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b44dcd-979b-48b6-b98c-52c13fee616a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.583381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.583572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.583572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.583698] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.583838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.583838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.584045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.585021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.585198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.585261] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0b44dcd-979b-48b6-b98c-52c13fee616a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.688828] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d9269ab-57a3-474d-a98c-7ba1583e57fc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.690452] env[69756]: INFO networking_nsxv3.common.synchronization [req-471c4929-dbc8-4ddb-b9cf-01f33562c3c7 req-2a2a8af3-b34a-4143-bdc0-4ba988809d32 tempest-MultipleCreateTestJSON-821679604 tempest-MultipleCreateTestJSON-821679604-project-member] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 928.692186] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 928.695769] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.695769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.695769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.695769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.695769] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.695769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.695769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.695769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.695769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.695769] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.725892] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85796156-67df-4d82-b494-0ea64303f9ba: rpc.has_security_group_logging(os_id): False [ 928.727781] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.748864] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.749036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.749100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.749667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.772770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.773062] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.773189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.773280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.773468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.773536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.773734] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.773830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.773890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.774068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.774286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.774352] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.774418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.774476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.774635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.774682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.774779] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 928.850864] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.851094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.851203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.851496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.851720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.874713] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 929.089908] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0b44dcd-979b-48b6-b98c-52c13fee616a: rpc.has_security_group_logging(os_id): False [ 929.110389] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.110610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.110700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.110972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.111092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.111407] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.111582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.111662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.111866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.111974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.112179] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.112284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.112335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.112528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.112609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.112835] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.112921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.113009] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.115294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.115402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.115507] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0b44dcd-979b-48b6-b98c-52c13fee616a is going to be created. [ 929.192389] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.192389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.192389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.192389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.192389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.192763] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc is going to be created. [ 929.194958] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.195377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.195377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.195556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.195784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.201957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.201957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.201957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.201957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.202411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.202411] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.202411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.202581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.202698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.202698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.202795] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 already deleted. [ 929.202845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.228159] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0b44dcd-979b-48b6-b98c-52c13fee616a in Status: IN_PROGRESS for 2s [ 929.230684] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.239602] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.239792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.239873] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.241647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.241931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.261209] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc in Status: UNINITIALIZED for 2s [ 929.732997] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.734187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.734187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.734187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.734187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.734187] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 929.769527] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.769690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.769790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.770167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.770342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.781084] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 929.796189] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.796189] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.796189] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.796189] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.796189] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.796189] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.796189] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.797165] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.798204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.798291] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.798374] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.798487] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.798599] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.798823] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.798959] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.799142] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.820057] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.820285] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 929.820444] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.820682] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.821183] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-e82b1804-ebb8-4335-ae61-a467a6960a12 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.821407] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-e82b1804-ebb8-4335-ae61-a467a6960a12" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.821551] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-e82b1804-ebb8-4335-ae61-a467a6960a12" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.821896] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-e82b1804-ebb8-4335-ae61-a467a6960a12" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.822070] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e82b1804-ebb8-4335-ae61-a467a6960a12',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.324933] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.329229] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.329229] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.329229] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.329229] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.333331] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port e82b1804-ebb8-4335-ae61-a467a6960a12 not found, creating... [ 930.333331] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.333331] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.333331] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.333331] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.333331] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.333331] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.333331] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.333331] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.333331] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.333710] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.333710] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: e82b1804-ebb8-4335-ae61-a467a6960a12 is going to be created. [ 930.363628] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.363900] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.364053] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.364255] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.364510] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.364732] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-e82b1804-ebb8-4335-ae61-a467a6960a12" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.894398] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 930.896340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.896340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.896340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.896340] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.246193] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0b44dcd-979b-48b6-b98c-52c13fee616a in Status: SUCCESS [ 931.246569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.270180] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc in Status: SUCCESS [ 931.270554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.270554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.272713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.272713] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.272713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.272713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.272713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.272713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.272713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.272713] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d9269ab-57a3-474d-a98c-7ba1583e57fc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.338270] env[69756]: INFO networking_nsxv3.common.synchronization [req-471c4929-dbc8-4ddb-b9cf-01f33562c3c7 req-243b7de7-0cef-4608-84d6-7974007126dd service nova] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_rules [ 931.338469] env[69756]: INFO networking_nsxv3.common.synchronization [req-471c4929-dbc8-4ddb-b9cf-01f33562c3c7 req-243b7de7-0cef-4608-84d6-7974007126dd service nova] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 931.339268] env[69756]: INFO networking_nsxv3.common.synchronization [req-471c4929-dbc8-4ddb-b9cf-01f33562c3c7 req-243b7de7-0cef-4608-84d6-7974007126dd service nova] Enqueued Resource ID: e82b1804-ebb8-4335-ae61-a467a6960a12 with Priority: HIGHEST for action port [ 931.339268] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_rules [ 931.339268] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 931.339268] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e82b1804-ebb8-4335-ae61-a467a6960a12 with Priority: HIGHEST for action port [ 931.339704] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.339704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.339704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.340564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.340564] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.341452] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.341576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.341643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.341832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.341981] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.342088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.342153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.342293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.342379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.342470] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.343247] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e82b1804-ebb8-4335-ae61-a467a6960a12 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.343356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e82b1804-ebb8-4335-ae61-a467a6960a12" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.343414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e82b1804-ebb8-4335-ae61-a467a6960a12" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.343568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e82b1804-ebb8-4335-ae61-a467a6960a12" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.343747] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e82b1804-ebb8-4335-ae61-a467a6960a12',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.397774] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.397774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.534038] env[69756]: INFO networking_nsxv3.common.synchronization [req-ec58f02c-c22e-406c-89a3-bceb590b3041 req-8c33f8ff-1c63-4a89-8a01-061b9c89e1fc tempest-ServersAdminNegativeTestJSON-1545143736 tempest-ServersAdminNegativeTestJSON-1545143736-project-member] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 931.534038] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 931.534038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.534038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.534038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.534038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.534593] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.534593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.534593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.534593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.534842] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.534842] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.776308] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9269ab-57a3-474d-a98c-7ba1583e57fc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.778302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.778302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.778302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.778302] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.778302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.778302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.778302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.778302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.778302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.778302] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9269ab-57a3-474d-a98c-7ba1583e57fc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.778654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.778654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.778923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.779173] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.779347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.779429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.779621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.779973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.780197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.781456] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d9269ab-57a3-474d-a98c-7ba1583e57fc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.798218] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 931.799080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.799763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.800089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.800320] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.800459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.800536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.800724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.804023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.804023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.804023] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.847386] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.848453] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.848563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.849855] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e82b1804-ebb8-4335-ae61-a467a6960a12 with status ACTIVE [ 931.849855] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.849855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.849855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.849855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.849855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.849855] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.849855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.849855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.850290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.850290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.850290] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.850434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.850507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.850758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.850758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.850854] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e82b1804-ebb8-4335-ae61-a467a6960a12 is going to be updated. [ 931.874654] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.875880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.875880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.875880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.875880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.875880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e82b1804-ebb8-4335-ae61-a467a6960a12" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.038394] env[69756]: INFO networking_nsxv3.common.synchronization [None req-56e589b3-6936-475c-b162-d1cf1fd6d57d None None] Enqueued Resource ID: d4597f55-e698-43de-8b8a-edf2b7bacfd2 with Priority: HIGHEST for action port [ 932.039471] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.039471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.039471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.039471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.039471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.039471] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.039857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.039857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.040549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.040834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.040834] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf already deleted. [ 932.040984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.041048] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4597f55-e698-43de-8b8a-edf2b7bacfd2 with Priority: HIGHEST for action port [ 932.041641] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4597f55-e698-43de-8b8a-edf2b7bacfd2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.041767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4597f55-e698-43de-8b8a-edf2b7bacfd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.041822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4597f55-e698-43de-8b8a-edf2b7bacfd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.042024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4597f55-e698-43de-8b8a-edf2b7bacfd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.042112] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4597f55-e698-43de-8b8a-edf2b7bacfd2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.283621] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d9269ab-57a3-474d-a98c-7ba1583e57fc: rpc.has_security_group_logging(os_id): False [ 932.308023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.308023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.308023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.308023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.308857] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.308857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.308857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.308857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.308857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.308857] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc is going to be created. [ 932.309499] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.309499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.309681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.309736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.309837] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.309945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.310024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.310182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.310254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.310336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.310473] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.310561] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.310633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.310778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.310922] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.314173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.314451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.315026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.315290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.315505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.315787] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.331918] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.332167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.332298] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.333210] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.333210] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.333210] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.333210] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.333444] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.333571] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.333734] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.333865] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.334046] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.334183] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.334299] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.334408] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.334538] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.352026] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.359041] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.359041] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 932.359041] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.359223] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.359478] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-917c27d3-6a33-4cc1-973a-179303c52050 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.359653] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-917c27d3-6a33-4cc1-973a-179303c52050" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.359809] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-917c27d3-6a33-4cc1-973a-179303c52050" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.364614] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-917c27d3-6a33-4cc1-973a-179303c52050" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.364614] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917c27d3-6a33-4cc1-973a-179303c52050',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.389767] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.390024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.390024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.390214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.390410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.415342] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc in Status: IN_PROGRESS for 2s [ 932.545136] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4597f55-e698-43de-8b8a-edf2b7bacfd2 [ 932.545778] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.545999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.546733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.546733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.546733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.546733] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4597f55-e698-43de-8b8a-edf2b7bacfd2 already deleted. [ 932.546733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4597f55-e698-43de-8b8a-edf2b7bacfd2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.819443] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85796156-67df-4d82-b494-0ea64303f9ba: rpc.has_security_group_logging(os_id): False [ 932.840680] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.840847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.840885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.841244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.841353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.841577] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.841676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.841739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.841904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.841988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.842177] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.842291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.844299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.844481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.844569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.844775] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.844877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.844942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.845108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.845186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.845273] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 932.863488] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.863488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.863488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.863488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.863488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.863488] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be created. [ 932.866869] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.868148] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.868333] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.868610] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.868953] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.868953] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 917c27d3-6a33-4cc1-973a-179303c52050 not found, creating... [ 932.870080] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.870080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.870080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.870080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.870080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.871358] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.871530] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.872555] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.873204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.873204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.873204] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 917c27d3-6a33-4cc1-973a-179303c52050 is going to be created. [ 932.889805] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.889948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.889990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.890257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.890578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.895807] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.896092] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.896229] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.896530] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.896768] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.897122] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-917c27d3-6a33-4cc1-973a-179303c52050" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.906137] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: UNINITIALIZED for 2s [ 932.922337] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.922494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.922564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.922817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.923021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.942557] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 934.080387] env[69756]: INFO networking_nsxv3.common.synchronization [req-7abf5f64-0174-47f0-8a99-9cc248094bd6 req-e7c60a8e-6241-45f2-a235-047ba30608ad tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 934.080387] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 934.080387] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.080387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.080387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.080387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.081366] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.081659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.081845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.082130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.082458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.082752] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.240947] env[69756]: INFO networking_nsxv3.common.synchronization [req-ec58f02c-c22e-406c-89a3-bceb590b3041 req-e4407b65-5023-4a9a-bd15-edd82eedc4eb service nova] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_rules [ 934.240947] env[69756]: INFO networking_nsxv3.common.synchronization [req-ec58f02c-c22e-406c-89a3-bceb590b3041 req-e4407b65-5023-4a9a-bd15-edd82eedc4eb service nova] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 934.240947] env[69756]: INFO networking_nsxv3.common.synchronization [req-ec58f02c-c22e-406c-89a3-bceb590b3041 req-e4407b65-5023-4a9a-bd15-edd82eedc4eb service nova] Enqueued Resource ID: 917c27d3-6a33-4cc1-973a-179303c52050 with Priority: HIGHEST for action port [ 934.241587] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_rules [ 934.241733] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 934.241828] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 917c27d3-6a33-4cc1-973a-179303c52050 with Priority: HIGHEST for action port [ 934.245278] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.245618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.245618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.245926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.245926] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.246794] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.247832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.247832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.247832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.247832] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.247832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.247832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.247832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.247832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.247832] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.249205] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-917c27d3-6a33-4cc1-973a-179303c52050 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.249205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-917c27d3-6a33-4cc1-973a-179303c52050" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.249205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-917c27d3-6a33-4cc1-973a-179303c52050" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.249205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-917c27d3-6a33-4cc1-973a-179303c52050" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.251361] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917c27d3-6a33-4cc1-973a-179303c52050',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.305884] env[69756]: INFO networking_nsxv3.common.synchronization [req-471c4929-dbc8-4ddb-b9cf-01f33562c3c7 req-244710f2-217b-44ee-b35d-03d4cf3f284e tempest-MultipleCreateTestJSON-821679604 tempest-MultipleCreateTestJSON-821679604-project-member] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 934.307842] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 934.309541] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.309648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.434241] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc in Status: SUCCESS [ 934.434334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.585966] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.587823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.587823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.587823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.587823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.587823] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.587823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.587823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.587823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.587823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.587823] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 934.627375] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.627375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.627375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.627375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.627375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.640712] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 934.668494] env[69756]: INFO networking_nsxv3.common.synchronization [None req-a14afa98-561d-4321-85ee-25cbf7e14f7b None None] Enqueued Resource ID: bc7c963d-ed65-43f8-9bac-2ef58a991693 with Priority: HIGHEST for action port [ 934.669321] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7c963d-ed65-43f8-9bac-2ef58a991693 with Priority: HIGHEST for action port [ 934.669662] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc7c963d-ed65-43f8-9bac-2ef58a991693 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.669808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc7c963d-ed65-43f8-9bac-2ef58a991693" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.669926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc7c963d-ed65-43f8-9bac-2ef58a991693" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.671542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc7c963d-ed65-43f8-9bac-2ef58a991693" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.671651] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc7c963d-ed65-43f8-9bac-2ef58a991693',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.703778] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.706072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.706072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.706312] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.707328] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.707647] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.707865] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.708629] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.708629] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.708808] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.709021] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.709208] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.709414] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.710130] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.710130] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.710130] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.738510] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.739502] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 934.739502] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.739502] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.739502] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-d71d0436-5642-4537-90ff-ef2bb5c8130a taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.740178] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-d71d0436-5642-4537-90ff-ef2bb5c8130a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.740178] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-d71d0436-5642-4537-90ff-ef2bb5c8130a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.740275] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-d71d0436-5642-4537-90ff-ef2bb5c8130a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.740721] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d71d0436-5642-4537-90ff-ef2bb5c8130a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.752055] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.759032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.759032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.759032] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 917c27d3-6a33-4cc1-973a-179303c52050 with status ACTIVE [ 934.759032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.759032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.759032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.759032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.759032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.759032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.759032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.759032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.759032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.759032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.759032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.759975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.759975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.759975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.759975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.759975] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 917c27d3-6a33-4cc1-973a-179303c52050 is going to be updated. [ 934.786546] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.786546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.786546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.786546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.786546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.786546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-917c27d3-6a33-4cc1-973a-179303c52050" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.925191] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 934.925527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.925733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.925990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.928332] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.928332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.928332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.928332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.928332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.928332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.928332] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.928332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.928332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.928690] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.928690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.928690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.928785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.928785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.929034] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.961679] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 934.961903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.176167] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc7c963d-ed65-43f8-9bac-2ef58a991693 [ 935.176167] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.176167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.176167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.176167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.176167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.176167] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc7c963d-ed65-43f8-9bac-2ef58a991693 already deleted. [ 935.176167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc7c963d-ed65-43f8-9bac-2ef58a991693" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.244829] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.248021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.248021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.248021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.248021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.248021] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port d71d0436-5642-4537-90ff-ef2bb5c8130a not found, creating... [ 935.248021] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.248021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.248021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.248021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.248021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.248462] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.248631] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.248908] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.249374] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.249574] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.249789] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: d71d0436-5642-4537-90ff-ef2bb5c8130a is going to be created. [ 935.257074] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.273417] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.273844] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.273844] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.274709] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.274709] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.274709] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-d71d0436-5642-4537-90ff-ef2bb5c8130a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.283871] env[69756]: INFO networking_nsxv3.common.synchronization [None req-89a366fc-1fa2-4c93-a4eb-b8f3c0fb6170 None None] Enqueued Resource ID: 5878badb-ffe8-4527-a1df-a186815986c9 with Priority: HIGHEST for action port [ 935.285036] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5878badb-ffe8-4527-a1df-a186815986c9 with Priority: HIGHEST for action port [ 935.285036] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5878badb-ffe8-4527-a1df-a186815986c9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.285036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5878badb-ffe8-4527-a1df-a186815986c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.285036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5878badb-ffe8-4527-a1df-a186815986c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.285371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5878badb-ffe8-4527-a1df-a186815986c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.285492] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5878badb-ffe8-4527-a1df-a186815986c9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.432356] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.432356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.433470] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.760013] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.760097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.760097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.760320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.760415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.760526] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf is going to be created. [ 935.786035] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.786035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.786035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.786282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.786754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.788052] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5878badb-ffe8-4527-a1df-a186815986c9 [ 935.788052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.788052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.788052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.788052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.788387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.788387] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5878badb-ffe8-4527-a1df-a186815986c9 already deleted. [ 935.788387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5878badb-ffe8-4527-a1df-a186815986c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.802274] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: UNINITIALIZED for 2s [ 935.934788] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.077662] env[69756]: INFO networking_nsxv3.common.synchronization [req-471c4929-dbc8-4ddb-b9cf-01f33562c3c7 req-df9405d2-2a2e-49a5-b087-39957ad736ec service nova] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_rules [ 936.077662] env[69756]: INFO networking_nsxv3.common.synchronization [req-471c4929-dbc8-4ddb-b9cf-01f33562c3c7 req-df9405d2-2a2e-49a5-b087-39957ad736ec service nova] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 936.077662] env[69756]: INFO networking_nsxv3.common.synchronization [req-471c4929-dbc8-4ddb-b9cf-01f33562c3c7 req-df9405d2-2a2e-49a5-b087-39957ad736ec service nova] Enqueued Resource ID: d71d0436-5642-4537-90ff-ef2bb5c8130a with Priority: HIGHEST for action port [ 936.082383] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_rules [ 936.082542] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 936.082639] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71d0436-5642-4537-90ff-ef2bb5c8130a with Priority: HIGHEST for action port [ 936.083271] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.083372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.083578] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.083656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.083827] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d71d0436-5642-4537-90ff-ef2bb5c8130a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.083930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d71d0436-5642-4537-90ff-ef2bb5c8130a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.084048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d71d0436-5642-4537-90ff-ef2bb5c8130a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.084301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d71d0436-5642-4537-90ff-ef2bb5c8130a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.084401] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d71d0436-5642-4537-90ff-ef2bb5c8130a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.437577] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.437866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.437866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.439513] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.439513] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.439513] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 936.469179] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.469268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.469375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.471019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.471019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.484273] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 936.592038] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d71d0436-5642-4537-90ff-ef2bb5c8130a with status ACTIVE [ 936.592038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.592038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.592038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.592038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.592038] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d71d0436-5642-4537-90ff-ef2bb5c8130a is going to be updated. [ 936.617836] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.617836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.617836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.617836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.617836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.617836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d71d0436-5642-4537-90ff-ef2bb5c8130a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.651761] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 936.651956] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 936.652102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.823221] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8b7d9f92-3638-4be2-8ac0-f67dda9fff4a None None] Enqueued Resource ID: 283e1ab1-dc0a-41bf-ba25-5d899c64dd83 with Priority: HIGHEST for action port [ 936.823844] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283e1ab1-dc0a-41bf-ba25-5d899c64dd83 with Priority: HIGHEST for action port [ 936.824194] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-283e1ab1-dc0a-41bf-ba25-5d899c64dd83 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.824373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-283e1ab1-dc0a-41bf-ba25-5d899c64dd83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.824424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-283e1ab1-dc0a-41bf-ba25-5d899c64dd83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.824725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-283e1ab1-dc0a-41bf-ba25-5d899c64dd83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.824797] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('283e1ab1-dc0a-41bf-ba25-5d899c64dd83',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.183207] env[69756]: INFO networking_nsxv3.common.synchronization [None req-554ab4fa-6de0-45a4-bb3a-035ad71abcaf None None] Enqueued Resource ID: 07138690-749b-4499-87c2-8c2914a1a94e with Priority: HIGHEST for action port [ 937.183488] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07138690-749b-4499-87c2-8c2914a1a94e with Priority: HIGHEST for action port [ 937.184147] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-07138690-749b-4499-87c2-8c2914a1a94e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.185029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07138690-749b-4499-87c2-8c2914a1a94e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.185029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07138690-749b-4499-87c2-8c2914a1a94e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.185029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07138690-749b-4499-87c2-8c2914a1a94e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.185029] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07138690-749b-4499-87c2-8c2914a1a94e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.277121] env[69756]: INFO networking_nsxv3.common.synchronization [req-0692aa8d-6a8b-4f88-b457-572bd1c81739 req-26932f7b-eaa8-4a94-8a5f-f11df9451ec6 tempest-ServersNegativeTestJSON-1110560868 tempest-ServersNegativeTestJSON-1110560868-project-member] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 937.277865] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 937.281064] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.281208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.281278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.281500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.281668] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.281786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.281852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.283613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.283613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.283613] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.328668] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 283e1ab1-dc0a-41bf-ba25-5d899c64dd83 [ 937.328668] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.328668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.328668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.328668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.328668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.328668] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:283e1ab1-dc0a-41bf-ba25-5d899c64dd83 already deleted. [ 937.328668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-283e1ab1-dc0a-41bf-ba25-5d899c64dd83" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.688023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07138690-749b-4499-87c2-8c2914a1a94e [ 937.688023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.688023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.688023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.688023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.688023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.688023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07138690-749b-4499-87c2-8c2914a1a94e already deleted. [ 937.688023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07138690-749b-4499-87c2-8c2914a1a94e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.788125] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.816315] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: SUCCESS [ 937.816396] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.816631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.816856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.817822] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.817994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.818095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.818315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.818408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.818529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.818631] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.290393] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.326165] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.326564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.327162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.327162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.330799] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.330799] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.330799] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.330799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.330799] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.421783] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-625 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.425366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.425366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.425366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.425366] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.425366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.425366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.425366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.425366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.425366] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.425366] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.425843] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.425843] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.425843] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.425997] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.430580] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.458359] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.459069] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.459069] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.459069] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.459236] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-a28125cf-0682-4761-853b-d8906298f7b1 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.459482] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-a28125cf-0682-4761-853b-d8906298f7b1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.459624] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-a28125cf-0682-4761-853b-d8906298f7b1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.460020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-a28125cf-0682-4761-853b-d8906298f7b1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.462753] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a28125cf-0682-4761-853b-d8906298f7b1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.497218] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 938.497218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.497218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.497469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.501049] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.501049] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.501049] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.501049] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.501049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.501817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.501817] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.501817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.501817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.501817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.501817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.501817] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.796059] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.796387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.796387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.796572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.796665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.796764] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be updated. [ 938.833648] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.833860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.834051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.834527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.834616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.836483] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf: rpc.has_security_group_logging(os_id): False [ 938.858331] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.858520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.858579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.858765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.858860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.859094] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.859187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.859253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.859418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.859497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.859681] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.859774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.859835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.860016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.860056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.860231] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.860578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.860578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.860578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.860578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.860746] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf is going to be created. [ 938.865340] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: IN_PROGRESS for 2s [ 938.945037] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.945037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.945037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.948213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.948213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.964630] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: IN_PROGRESS for 2s [ 938.967640] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.967935] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.968134] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.971055] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.971055] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.971055] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port a28125cf-0682-4761-853b-d8906298f7b1 not found, creating... [ 938.973179] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.973407] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.973547] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.973909] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.976658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.977127] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.977334] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.977460] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.977834] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.978009] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.978201] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: a28125cf-0682-4761-853b-d8906298f7b1 is going to be created. [ 939.002991] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.003241] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.003374] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.003670] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.003906] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.004196] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-a28125cf-0682-4761-853b-d8906298f7b1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.005906] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.007600] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d34ec2a1-9b82-4a22-adf9-c9f049d563f8: rpc.has_security_group_logging(os_id): False [ 939.034833] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.035115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.035375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.035683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.035786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.036119] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.036256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.036672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.036876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.037099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.037293] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.037406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.037472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.037659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.037774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.038234] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.038350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.038418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.038653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.038653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.039137] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be created. [ 939.132700] env[69756]: INFO networking_nsxv3.common.synchronization [None req-bca792c1-52dd-4b42-b9c2-64f5aa16c473 None None] Enqueued Resource ID: c43c33ec-7255-4b8f-b51b-434f72721468 with Priority: HIGHEST for action port [ 939.137172] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c33ec-7255-4b8f-b51b-434f72721468 with Priority: HIGHEST for action port [ 939.137172] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c43c33ec-7255-4b8f-b51b-434f72721468 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.137172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c43c33ec-7255-4b8f-b51b-434f72721468" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.137172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c43c33ec-7255-4b8f-b51b-434f72721468" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.137172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c43c33ec-7255-4b8f-b51b-434f72721468" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.137172] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c43c33ec-7255-4b8f-b51b-434f72721468',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.200308] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.202553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.202553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.202553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.202553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.220493] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 939.389098] env[69756]: INFO networking_nsxv3.common.synchronization [req-5b60d52a-a79b-40f0-adce-634ae162678d req-20afa1db-c8dc-4c58-8029-e2c5e521889e tempest-ServerDiagnosticsTest-1841012087 tempest-ServerDiagnosticsTest-1841012087-project-member] Enqueued Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGHEST for action security_group_members [ 939.389613] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGHEST for action security_group_members [ 939.389923] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9269ab-57a3-474d-a98c-7ba1583e57fc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.390132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.390132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.390347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.390564] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.390704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.390796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.390960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.391289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.391397] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d9269ab-57a3-474d-a98c-7ba1583e57fc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.510095] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.643929] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c43c33ec-7255-4b8f-b51b-434f72721468 [ 939.644299] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.644437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.644613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.644754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.644846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.644955] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c43c33ec-7255-4b8f-b51b-434f72721468 already deleted. [ 939.645039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c43c33ec-7255-4b8f-b51b-434f72721468" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.895638] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.896041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.896041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.898374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.898594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.898856] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.899020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.899591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.899885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.903211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.903211] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc is going to be updated. [ 939.936308] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.936503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.936595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.936757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.936916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.947631] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc in Status: IN_PROGRESS for 2s [ 940.013671] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.013923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.013923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.014247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.014337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.014391] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 940.054672] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.054752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.054867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.055066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.055185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.066951] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 940.227227] env[69756]: INFO networking_nsxv3.common.synchronization [req-0692aa8d-6a8b-4f88-b457-572bd1c81739 req-2938a671-2a64-4eee-a0f3-718299fb121d service nova] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_rules [ 940.229022] env[69756]: INFO networking_nsxv3.common.synchronization [req-0692aa8d-6a8b-4f88-b457-572bd1c81739 req-2938a671-2a64-4eee-a0f3-718299fb121d service nova] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 940.229022] env[69756]: INFO networking_nsxv3.common.synchronization [req-0692aa8d-6a8b-4f88-b457-572bd1c81739 req-2938a671-2a64-4eee-a0f3-718299fb121d service nova] Enqueued Resource ID: a28125cf-0682-4761-853b-d8906298f7b1 with Priority: HIGHEST for action port [ 940.229205] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_rules [ 940.229334] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 940.229436] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28125cf-0682-4761-853b-d8906298f7b1 with Priority: HIGHEST for action port [ 940.229725] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.229869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.229908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.230155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.230322] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.231485] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.231598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.231825] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a28125cf-0682-4761-853b-d8906298f7b1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.231951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a28125cf-0682-4761-853b-d8906298f7b1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.231951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a28125cf-0682-4761-853b-d8906298f7b1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.232159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a28125cf-0682-4761-853b-d8906298f7b1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.232233] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a28125cf-0682-4761-853b-d8906298f7b1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.278269] env[69756]: INFO networking_nsxv3.common.synchronization [req-791d58bc-c13d-4882-b209-d597705530a7 req-5604a325-d330-43c4-b2ca-905c0ae1748d tempest-ServersTestJSON-1985496736 tempest-ServersTestJSON-1985496736-project-member] Enqueued Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_members [ 940.279112] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_members [ 940.279554] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-49317fc3-59c5-4b8b-a14b-79b0c266a17a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.279683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.279805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.280091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.280460] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.280460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.280584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.280658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.280748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.280841] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.736039] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.736039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.737580] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a28125cf-0682-4761-853b-d8906298f7b1 with status ACTIVE [ 940.737810] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.738319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.738459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.738601] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.738722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.738957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.739065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.739101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.739390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.739390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.739603] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.739851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.739851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.739912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.739942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.740098] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a28125cf-0682-4761-853b-d8906298f7b1 is going to be updated. [ 940.771300] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.771470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.771588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.771719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.772507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.772507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a28125cf-0682-4761-853b-d8906298f7b1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.787706] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.787953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.788106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.788243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.788343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.789234] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.789234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.789234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.789234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.789234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.789234] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a already deleted. [ 940.789234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.831037] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.831311] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.831474] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.831836] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.832160] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.832359] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.832511] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.832766] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.832954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.833210] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.833360] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.833501] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.833723] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.834042] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.834208] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.834374] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.890206] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.890386] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.056 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 940.890530] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.890711] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.891042] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.891226] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.891346] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.891702] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.891874] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b6b489c-c333-43e5-959e-b3ee1a3c65c0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.898924] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: SUCCESS [ 940.898924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.898924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.898924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.899210] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.899210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.899210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.899336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.899420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.899515] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.978846] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: SUCCESS [ 940.979155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.237489] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 941.237807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.238123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.238443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.238591] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.400021] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.400021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.400021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.400021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.400021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.400021] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 7b6b489c-c333-43e5-959e-b3ee1a3c65c0 not found, creating... [ 941.400021] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.400021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.400021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.400021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.400021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.400482] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.400482] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.401322] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.401840] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.402212] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.402518] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 7b6b489c-c333-43e5-959e-b3ee1a3c65c0 is going to be created. [ 941.405253] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.431833] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.431833] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.431833] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.431833] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.431833] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.431833] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.743023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.743023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.909756] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.957415] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc in Status: SUCCESS [ 941.957618] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc deletion is rescheduled due to dependency. [ 941.957743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.078482] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 942.078727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.079073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.079145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.079441] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.079576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.079576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.079693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.079955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.079955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.079955] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.413347] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.413590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.413669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.413916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.414031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.415145] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be updated. [ 942.463200] env[69756]: INFO networking_nsxv3.common.synchronization [req-791d58bc-c13d-4882-b209-d597705530a7 req-db79f811-5925-4ef5-96c5-53500b419aab service nova] Enqueued Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_rules [ 942.463477] env[69756]: INFO networking_nsxv3.common.synchronization [req-791d58bc-c13d-4882-b209-d597705530a7 req-db79f811-5925-4ef5-96c5-53500b419aab service nova] Enqueued Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_members [ 942.463711] env[69756]: INFO networking_nsxv3.common.synchronization [req-791d58bc-c13d-4882-b209-d597705530a7 req-db79f811-5925-4ef5-96c5-53500b419aab service nova] Enqueued Resource ID: 7b6b489c-c333-43e5-959e-b3ee1a3c65c0 with Priority: HIGHEST for action port [ 942.464619] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_rules [ 942.464867] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_members [ 942.465188] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b6b489c-c333-43e5-959e-b3ee1a3c65c0 with Priority: HIGHEST for action port [ 942.465435] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.465649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.465790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.466067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.466183] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.468637] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-49317fc3-59c5-4b8b-a14b-79b0c266a17a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.468786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.468969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.469214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.469398] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.469488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.469569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.469884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.469884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.469960] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.472043] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.472043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.472043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.472043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.472043] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b6b489c-c333-43e5-959e-b3ee1a3c65c0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.479804] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.479804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.479804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.480043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.480043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.498658] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: IN_PROGRESS for 2s [ 942.501318] env[69756]: INFO networking_nsxv3.common.synchronization [req-ae2a94e2-4afe-473d-a8fe-3d003e66e295 req-85f707c9-067c-42b7-954b-e39a8d3ebd62 tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 942.502309] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 942.503354] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.503493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.503567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.503890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.504079] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.504190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.504471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.504679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.505010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.505135] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.588461] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.588461] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.588461] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.588461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.589758] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.589758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.589758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.589758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.589758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.589758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.589758] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.969070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-49317fc3-59c5-4b8b-a14b-79b0c266a17a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.969451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.971652] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.976503] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b6b489c-c333-43e5-959e-b3ee1a3c65c0 with status ACTIVE [ 942.976727] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.976854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.976960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.978021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.978021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.978021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.978021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.978021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.978021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.978275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.978275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.978394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.978504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.978573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.978747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.978747] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b6b489c-c333-43e5-959e-b3ee1a3c65c0 is going to be updated. [ 943.006241] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.006417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.006512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.006860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.006975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.007195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b6b489c-c333-43e5-959e-b3ee1a3c65c0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.007528] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.007658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.007747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.007998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.008284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.008463] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.008536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.008603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.008757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.008853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.008935] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 already deleted. [ 943.009032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.012170] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.012356] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.012480] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.012766] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.013068] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.013229] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.013350] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.013563] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.013701] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.013900] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.014205] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.014205] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.014295] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.014342] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.014442] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.014571] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.036060] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.036060] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 943.036060] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.036060] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.036060] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-477e7819-890c-49bb-8248-85fadf5cd915 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.036405] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-477e7819-890c-49bb-8248-85fadf5cd915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.036405] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-477e7819-890c-49bb-8248-85fadf5cd915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.036645] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-477e7819-890c-49bb-8248-85fadf5cd915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.036782] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('477e7819-890c-49bb-8248-85fadf5cd915',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.092201] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d34ec2a1-9b82-4a22-adf9-c9f049d563f8: rpc.has_security_group_logging(os_id): False [ 943.133772] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.133981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.133981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.134270] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.134395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.134607] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.134703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.134778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.134955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.135094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.135287] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.135382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.135450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.135630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.135706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.135952] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.136074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.136131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.136303] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.136382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.136487] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 943.228140] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.228380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.228380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.228673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.228909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.243604] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 943.474307] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.539661] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.539881] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.540015] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.540316] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.540470] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.540629] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 477e7819-890c-49bb-8248-85fadf5cd915 not found, creating... [ 943.540896] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.541106] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.541397] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.541582] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.541728] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.542072] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.542275] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.542404] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.542613] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.542748] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.542892] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 477e7819-890c-49bb-8248-85fadf5cd915 is going to be created. [ 943.566968] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.567187] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.567264] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.567495] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.567735] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.568025] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-477e7819-890c-49bb-8248-85fadf5cd915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.977058] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.977360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.977360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.977718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.977876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.978081] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a is going to be created. [ 944.007506] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.007697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.007771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.008147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.008345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.020017] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a in Status: UNINITIALIZED for 2s [ 944.387024] env[69756]: INFO networking_nsxv3.common.synchronization [req-ae2a94e2-4afe-473d-a8fe-3d003e66e295 req-c1400493-8a9a-4745-801e-8416a478e05e service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 944.387024] env[69756]: INFO networking_nsxv3.common.synchronization [req-ae2a94e2-4afe-473d-a8fe-3d003e66e295 req-c1400493-8a9a-4745-801e-8416a478e05e service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 944.387024] env[69756]: INFO networking_nsxv3.common.synchronization [req-ae2a94e2-4afe-473d-a8fe-3d003e66e295 req-c1400493-8a9a-4745-801e-8416a478e05e service nova] Enqueued Resource ID: 477e7819-890c-49bb-8248-85fadf5cd915 with Priority: HIGHEST for action port [ 944.387024] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 944.387024] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 944.387024] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477e7819-890c-49bb-8248-85fadf5cd915 with Priority: HIGHEST for action port [ 944.387024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.387024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.387024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.387024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.387024] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.388558] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.388558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.388558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.388558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.388558] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.388859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.388859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.388859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.388993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.388993] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.390133] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-477e7819-890c-49bb-8248-85fadf5cd915 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.390293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-477e7819-890c-49bb-8248-85fadf5cd915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.390338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-477e7819-890c-49bb-8248-85fadf5cd915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.390470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-477e7819-890c-49bb-8248-85fadf5cd915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.390562] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('477e7819-890c-49bb-8248-85fadf5cd915',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.509159] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: SUCCESS [ 944.509425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.509649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.510411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.510411] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.510411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.510411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.510670] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.510670] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.510670] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.510765] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.893055] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.893179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.893368] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 477e7819-890c-49bb-8248-85fadf5cd915 with status ACTIVE [ 944.893556] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.893669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.893735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.893961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.894069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.894243] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.894341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.894402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.894636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.894724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.894844] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.894941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.895011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.895187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.895262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.895349] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 477e7819-890c-49bb-8248-85fadf5cd915 is going to be updated. [ 944.896632] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.919126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.919343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.919385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.919620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.919766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.919937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-477e7819-890c-49bb-8248-85fadf5cd915" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.013746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.014218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.014218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.014292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.014538] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.015260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.015260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.015260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.015260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.015260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.015546] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.015546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.015622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.015860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.016128] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.016267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.016379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.016831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.016831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.016831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.017026] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.257196] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 945.257456] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.399779] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.519870] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 285c5000-ac60-42b0-8441-f857f98438d0: rpc.has_security_group_logging(os_id): False [ 945.539630] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.540283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.540283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.540283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.563786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.564117] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.564304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.564304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.564503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.564578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.564780] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.564898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.564963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.565139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.565218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.565432] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.565514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.565591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.565711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.565777] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.565855] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be updated. [ 945.632154] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.632463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.632463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.632653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.632819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.649218] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: IN_PROGRESS for 2s [ 945.902645] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.902888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.902888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.903160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.903268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.903394] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be created. [ 945.928552] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.928820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.928820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.929052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.929209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.945279] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: UNINITIALIZED for 2s [ 946.030618] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a in Status: SUCCESS [ 946.030887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.031083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.031335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.031577] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.031808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.031889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.033816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.033816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.033816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.033816] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.535881] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.038285] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49317fc3-59c5-4b8b-a14b-79b0c266a17a: rpc.has_security_group_logging(os_id): False [ 947.060599] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.060599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.060956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.060956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.061059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.061238] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.061344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.061404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.061576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.061652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.061727] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a is going to be created. [ 947.144216] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.144544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.144690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.145066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.145393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.179022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a in Status: IN_PROGRESS for 2s [ 947.662706] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: SUCCESS [ 947.662706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.956087] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 947.956286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.956447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.956654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.956905] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.957046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.957115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.957295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.957397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.957487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.957582] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.460454] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.461027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.461027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.461027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.461198] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.461198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.461353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.461387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.461455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.461546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.461697] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.461807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.461861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.462013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.462212] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.462369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.462369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.462541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.462541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.462612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.462676] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.964560] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8: rpc.has_security_group_logging(os_id): False [ 948.985046] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.985287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.985460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.985704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.985817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.986147] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.986262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.986325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.986514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.986544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.986743] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.986850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.986927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.987588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.987692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.987874] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.988051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.988684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.988911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.989154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.989424] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be created. [ 949.063548] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.063787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.063832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.064164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.064478] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.085437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 949.210210] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a in Status: SUCCESS [ 949.210496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.380456] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 949.380599] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 949.669537] env[69756]: INFO networking_nsxv3.common.synchronization [req-e0df13b1-a61c-46d6-819f-7fb8259cb76d req-d19864a9-e479-4b77-9bbc-33d2f12ad07e tempest-ServersAdminTestJSON-2109728624 tempest-ServersAdminTestJSON-2109728624-project-member] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 949.672391] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 949.672712] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.672837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.672907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.673144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.673306] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.673406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.673463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.673620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.673707] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.673802] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.071209] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.071209] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.071209] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.071209] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.071209] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.071209] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.073965] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.073965] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.073965] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.073965] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.074151] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.074151] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.074253] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.074380] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.074494] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.074650] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.099606] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.099606] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 950.099985] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.099985] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-473" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.100278] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-8b736b9f-95d8-41c5-a370-4fe63e601e4c taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.100506] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-8b736b9f-95d8-41c5-a370-4fe63e601e4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.100628] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-8b736b9f-95d8-41c5-a370-4fe63e601e4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.100994] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-8b736b9f-95d8-41c5-a370-4fe63e601e4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.101147] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b736b9f-95d8-41c5-a370-4fe63e601e4c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.178928] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.605646] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.605971] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.606199] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.606613] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.606836] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.607086] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 8b736b9f-95d8-41c5-a370-4fe63e601e4c not found, creating... [ 950.607496] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.607730] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.607913] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.612857] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.612857] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.612857] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.612857] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.612857] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.612857] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.613101] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.613456] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 8b736b9f-95d8-41c5-a370-4fe63e601e4c is going to be created. [ 950.650119] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.650119] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.650119] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.650119] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.650119] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.650119] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-8b736b9f-95d8-41c5-a370-4fe63e601e4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.680883] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.102646] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 951.102646] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.186029] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.186029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.186029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.186029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.186029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.186029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 951.237384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.237612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.237713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.237973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.238207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.252422] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 951.810315] env[69756]: INFO networking_nsxv3.common.synchronization [req-e0df13b1-a61c-46d6-819f-7fb8259cb76d req-f9c2afbf-1329-46e4-a058-3e536b2ff4d9 service nova] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_rules [ 951.814019] env[69756]: INFO networking_nsxv3.common.synchronization [req-e0df13b1-a61c-46d6-819f-7fb8259cb76d req-f9c2afbf-1329-46e4-a058-3e536b2ff4d9 service nova] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 951.814019] env[69756]: INFO networking_nsxv3.common.synchronization [req-e0df13b1-a61c-46d6-819f-7fb8259cb76d req-f9c2afbf-1329-46e4-a058-3e536b2ff4d9 service nova] Enqueued Resource ID: 8b736b9f-95d8-41c5-a370-4fe63e601e4c with Priority: HIGHEST for action port [ 951.814019] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_rules [ 951.814019] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 951.814019] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b736b9f-95d8-41c5-a370-4fe63e601e4c with Priority: HIGHEST for action port [ 951.814019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.814019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.814019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.814019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.814019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.814019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.814019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.814019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b736b9f-95d8-41c5-a370-4fe63e601e4c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.814835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b736b9f-95d8-41c5-a370-4fe63e601e4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.815008] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b736b9f-95d8-41c5-a370-4fe63e601e4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.815330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b736b9f-95d8-41c5-a370-4fe63e601e4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.815544] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b736b9f-95d8-41c5-a370-4fe63e601e4c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.296509] env[69756]: INFO networking_nsxv3.common.synchronization [req-0212a8fa-9b40-4e82-ad67-f5c1f27b62ba req-19df3d91-e755-4782-816d-a988ea2afaad tempest-MigrationsAdminTest-188051455 tempest-MigrationsAdminTest-188051455-project-member] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 952.296509] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 952.297037] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.297444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.297709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.298199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.298615] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.299061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.299263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.299651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.299868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.300654] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.318411] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.318646] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.318967] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b736b9f-95d8-41c5-a370-4fe63e601e4c with status ACTIVE [ 952.319261] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.320243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.320391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.320705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.321569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.322577] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.322577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.322577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.322577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.322577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.323154] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.324212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.324212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.324212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.324212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.324212] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b736b9f-95d8-41c5-a370-4fe63e601e4c is going to be updated. [ 952.371652] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.371899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.371899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.373640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.373640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.373640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b736b9f-95d8-41c5-a370-4fe63e601e4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.806781] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.031492] env[69756]: INFO networking_nsxv3.common.synchronization [req-7f4872e0-1ebd-4fc9-a01d-26a057380e49 req-a2893a57-4ada-4c10-b367-0b6de1f0f46f tempest-MultipleCreateTestJSON-821679604 tempest-MultipleCreateTestJSON-821679604-project-member] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 953.032362] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 953.032362] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.032604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.032604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.032697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.032854] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.033287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.033287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.033287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.033287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.033517] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.086252] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.086252] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.086252] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.086252] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.086252] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.086252] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.086252] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.086252] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.087351] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.087351] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.087351] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.087351] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.087351] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.087351] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.087800] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.092569] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.114169] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.115141] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 953.116085] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.116373] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.116714] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-d81628ad-87f9-4de4-b01a-60f6425c88be taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.116893] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-d81628ad-87f9-4de4-b01a-60f6425c88be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.117022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-d81628ad-87f9-4de4-b01a-60f6425c88be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.117413] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-d81628ad-87f9-4de4-b01a-60f6425c88be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.117561] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81628ad-87f9-4de4-b01a-60f6425c88be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.265133] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 953.265133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.265133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.265133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.265133] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.265133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.265133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.265133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.265133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.265133] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.312352] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.479658] env[69756]: INFO networking_nsxv3.common.synchronization [req-29d5077b-61f9-4afc-8e8b-c0ca79f0ccef req-5610868e-18f5-44c0-b3dd-d03184b95de4 tempest-MultipleCreateTestJSON-821679604 tempest-MultipleCreateTestJSON-821679604-project-member] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 953.479658] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 953.481600] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.481916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.536381] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.620011] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.620238] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.620371] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.620659] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.620814] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.620974] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port d81628ad-87f9-4de4-b01a-60f6425c88be not found, creating... [ 953.621266] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.621430] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.625111] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.625828] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.625828] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.625946] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.626136] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.626274] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.626512] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.626656] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.626808] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: d81628ad-87f9-4de4-b01a-60f6425c88be is going to be created. [ 953.651679] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.651819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.651869] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.652185] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.652443] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.652678] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-d81628ad-87f9-4de4-b01a-60f6425c88be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.768586] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.813977] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.816530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.816530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.816530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.816530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.816530] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9593-3500-4c12-99da-d35935a142b3 is going to be updated. [ 953.859739] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.859904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.859999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.860219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.860411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.875497] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: IN_PROGRESS for 2s [ 953.920453] env[69756]: INFO networking_nsxv3.common.synchronization [req-b2085ce2-8a1e-41c3-aa88-fa7e9df5d481 req-5582ac06-6e63-4486-85d4-42eba2ffb64e tempest-ServersNegativeTestJSON-1110560868 tempest-ServersNegativeTestJSON-1110560868-project-member] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 953.920453] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 953.920453] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.920453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.920453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.920708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.920708] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.920813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.920895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.921092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.921180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.921276] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.039418] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.271281] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.428823] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.472232] env[69756]: INFO networking_nsxv3.common.synchronization [req-0212a8fa-9b40-4e82-ad67-f5c1f27b62ba req-ee3cbd44-86b8-4851-b6c8-50bf4f8d8eae service nova] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_rules [ 954.472232] env[69756]: INFO networking_nsxv3.common.synchronization [req-0212a8fa-9b40-4e82-ad67-f5c1f27b62ba req-ee3cbd44-86b8-4851-b6c8-50bf4f8d8eae service nova] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 954.472232] env[69756]: INFO networking_nsxv3.common.synchronization [req-0212a8fa-9b40-4e82-ad67-f5c1f27b62ba req-ee3cbd44-86b8-4851-b6c8-50bf4f8d8eae service nova] Enqueued Resource ID: d81628ad-87f9-4de4-b01a-60f6425c88be with Priority: HIGHEST for action port [ 954.472232] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_rules [ 954.472963] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 954.472963] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81628ad-87f9-4de4-b01a-60f6425c88be with Priority: HIGHEST for action port [ 954.474486] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.474624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.474691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.474901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.474996] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.475999] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.476125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.476571] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d81628ad-87f9-4de4-b01a-60f6425c88be taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.476683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d81628ad-87f9-4de4-b01a-60f6425c88be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.476745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d81628ad-87f9-4de4-b01a-60f6425c88be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.476918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d81628ad-87f9-4de4-b01a-60f6425c88be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.476995] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81628ad-87f9-4de4-b01a-60f6425c88be',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.541886] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.542072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.542174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.542344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.542432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.542530] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 954.571895] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.572094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.572131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.572324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.572465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.581924] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 954.775226] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.775226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.775449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.775511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.776063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.776063] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 954.811424] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.811577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.811649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.811865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.812012] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.823029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 954.934240] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.980019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.982250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.982250] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d81628ad-87f9-4de4-b01a-60f6425c88be with status ACTIVE [ 954.982250] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.982250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.982250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.982250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.982250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.982250] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.984882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.984882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.984882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.984882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.985231] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.985231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.985231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.985476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.985476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.985476] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d81628ad-87f9-4de4-b01a-60f6425c88be is going to be updated. [ 955.008814] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.008944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.009008] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.009328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.010177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.010177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d81628ad-87f9-4de4-b01a-60f6425c88be" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.024135] env[69756]: INFO networking_nsxv3.common.synchronization [req-363d8210-1ea4-4782-b7b7-f603a5d5b304 req-b53c1773-2df1-477d-b986-c1540a4774c8 tempest-ServerTagsTestJSON-43809088 tempest-ServerTagsTestJSON-43809088-project-member] Enqueued Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGHEST for action security_group_members [ 955.024135] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGHEST for action security_group_members [ 955.024135] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd71eef3-fdb4-4293-8cf4-077891626874 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.024135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.024135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.024135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.024135] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.024135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.024135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.024135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.030636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.030636] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd71eef3-fdb4-4293-8cf4-077891626874',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.438140] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.438459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.438459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.438602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.438643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.438737] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be updated. [ 955.467552] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.467726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.467904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.468220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.468444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.483471] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.483672] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-207" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.483794] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-207" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.484200] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-207" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.484473] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.484634] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.484752] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.484973] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.485135] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.485343] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.485458] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.485572] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.485683] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.485861] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.485989] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.486140] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.490269] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: IN_PROGRESS for 2s [ 955.508126] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.508345] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 955.508490] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.508689] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-207" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.509020] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.511392] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.511547] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.511887] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.512051] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.533097] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.533097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.533097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.533097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.533097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.533097] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.533097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.533097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.533097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.533097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.533541] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd71eef3-fdb4-4293-8cf4-077891626874 already deleted. [ 955.533541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.886076] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: SUCCESS [ 955.886349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.886536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.887248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.887248] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.887248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.887392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.888186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.888712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.888712] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.014454] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.014675] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.014808] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.015337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.015337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.015488] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3 not found, creating... [ 956.015656] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.015815] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.015935] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.016179] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.016321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.016599] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.016805] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.016936] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.017177] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.017314] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.017455] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3 is going to be created. [ 956.037426] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.037632] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.037759] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.038045] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.038308] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.038544] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.393167] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.596597] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 956.597092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.597092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.597358] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.597558] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.597678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.597744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.597949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.598061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.598298] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.834486] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 956.834486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.834486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.834486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.834486] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.834486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.834486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.834486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.834486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.834486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.834486] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.861020] env[69756]: INFO networking_nsxv3.common.synchronization [req-363d8210-1ea4-4782-b7b7-f603a5d5b304 req-972b9946-74bf-475b-93b8-c4a72e3a79ca service nova] Enqueued Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGHEST for action security_group_rules [ 956.861211] env[69756]: INFO networking_nsxv3.common.synchronization [req-363d8210-1ea4-4782-b7b7-f603a5d5b304 req-972b9946-74bf-475b-93b8-c4a72e3a79ca service nova] Enqueued Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGHEST for action security_group_members [ 956.861326] env[69756]: INFO networking_nsxv3.common.synchronization [req-363d8210-1ea4-4782-b7b7-f603a5d5b304 req-972b9946-74bf-475b-93b8-c4a72e3a79ca service nova] Enqueued Resource ID: 8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3 with Priority: HIGHEST for action port [ 956.861551] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGHEST for action security_group_rules [ 956.861669] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGHEST for action security_group_members [ 956.861764] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3 with Priority: HIGHEST for action port [ 956.862329] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd71eef3-fdb4-4293-8cf4-077891626874 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.862446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.862541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.864159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.864159] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd71eef3-fdb4-4293-8cf4-077891626874',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.866275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd71eef3-fdb4-4293-8cf4-077891626874 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.866275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.866275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.866275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.866275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.866275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.866275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.866275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.866275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.866275] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd71eef3-fdb4-4293-8cf4-077891626874',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.867099] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.867099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.867203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.867318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.867396] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.894615] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.100977] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.100977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.100977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.100977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.100977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.101247] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.104257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.104257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.104257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.104257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.104257] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 957.131563] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.132740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.132740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.132740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.132740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.142572] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 957.162308] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3da5730-ef4b-4c39-926f-96d6cdece266 req-73bef7f0-786b-42c5-b6f7-03196dce56a5 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 957.162536] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3da5730-ef4b-4c39-926f-96d6cdece266 req-73bef7f0-786b-42c5-b6f7-03196dce56a5 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc with Priority: HIGHEST for action security_group_members [ 957.162717] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3da5730-ef4b-4c39-926f-96d6cdece266 req-73bef7f0-786b-42c5-b6f7-03196dce56a5 tempest-SecurityGroupsTestJSON-55145632 tempest-SecurityGroupsTestJSON-55145632-project-member] Enqueued Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 957.164523] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGHEST for action security_group_members [ 957.164821] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc with Priority: HIGHEST for action security_group_members [ 957.165014] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGHEST for action security_group_members [ 957.165366] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.165669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.165770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.166507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.166758] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.166918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.167019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.167284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.167408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.167554] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.168960] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.168960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.168960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.169144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.169356] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.169505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.169505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.169603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.169665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.169995] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b6578e8-a78e-4c09-82f2-a7faaacca9bc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.170584] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.170683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.170800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.170895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.171071] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.171169] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.171232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.171374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.171449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.171532] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.337180] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.337371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.337371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.340144] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.340144] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.340144] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.340144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.340144] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.365930] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd71eef3-fdb4-4293-8cf4-077891626874 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.366164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.369886] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd71eef3-fdb4-4293-8cf4-077891626874',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.371260] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3 with status ACTIVE [ 957.371260] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.371260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.371260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.371515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.371515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.373297] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.373297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.373297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.373297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.373297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.373297] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.373297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.373297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.373297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.373297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.373297] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3 is going to be updated. [ 957.399809] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.399809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.399809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.399809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.399809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.399809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8daf79c3-671d-4b2d-bcaf-6fd73fb64dd3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.399809] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.399809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.399809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.399809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.399809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.399809] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9593-3500-4c12-99da-d35935a142b3 is going to be updated. [ 957.448287] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.448484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.448579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.449074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.449074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.465779] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: IN_PROGRESS for 2s [ 957.495254] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 957.495393] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:1 started [ 957.508799] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: SUCCESS [ 957.508970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.675078] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.675492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.675492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.675782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.677323] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.677467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.677702] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.677797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.701397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.701397] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.701397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.701397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.701646] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.702131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.702131] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc is going to be updated. [ 957.704594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.704594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.704594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.704594] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.704594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.704594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.704594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.704594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.704594] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be updated. [ 957.705775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.705878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.747088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.747088] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.747088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.747088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.747398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.747398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.747398] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce is going to be updated. [ 957.754814] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.754976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.755100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.755342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.755515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.763777] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.763924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.763992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.764264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.764398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.768611] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc in Status: IN_PROGRESS for 2s [ 957.780649] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: IN_PROGRESS for 2s [ 957.819673] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.819881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.820016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.820289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.820555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.831724] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: IN_PROGRESS for 2s [ 957.843584] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734: rpc.has_security_group_logging(os_id): False [ 957.865117] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.866018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.866018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.866018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.875532] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd71eef3-fdb4-4293-8cf4-077891626874',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.903677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.904066] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.904232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.904326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.904587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.904732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.905233] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.905476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.905643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.905899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.906200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.906470] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.906632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.907692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.907692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.907692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.907692] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 958.003016] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.003016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.003016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.003016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.003016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.015903] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 958.378712] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.378916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.378976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.379255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.379393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.379500] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd71eef3-fdb4-4293-8cf4-077891626874 is going to be created. [ 958.411547] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.411720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.411768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.412438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.412438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.426547] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd71eef3-fdb4-4293-8cf4-077891626874 in Status: UNINITIALIZED for 2s [ 959.159406] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 959.159708] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 deletion is rescheduled due to dependency. [ 959.159807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.475577] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: SUCCESS [ 959.475802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.475973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.476227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.476431] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.476560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.476619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.476772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.476854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.476961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.477026] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.784357] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc in Status: SUCCESS [ 959.784357] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b6578e8-a78e-4c09-82f2-a7faaacca9bc deletion is rescheduled due to dependency. [ 959.784357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b6578e8-a78e-4c09-82f2-a7faaacca9bc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.794254] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85796156-67df-4d82-b494-0ea64303f9ba in Status: SUCCESS [ 959.794631] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85796156-67df-4d82-b494-0ea64303f9ba deletion is rescheduled due to dependency. [ 959.794631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.842994] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce in Status: SUCCESS [ 959.843213] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce deletion is rescheduled due to dependency. [ 959.843333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.980123] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.980982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.980982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.983199] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.983199] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.983199] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.983199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.983199] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.030732] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 960.030961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.070434] env[69756]: INFO networking_nsxv3.common.synchronization [req-e2443311-f9cc-4af7-aa11-41ec26a31530 req-508af8a3-d142-4c65-8545-2ac0d31b5528 tempest-ImagesOneServerNegativeTestJSON-724061913 tempest-ImagesOneServerNegativeTestJSON-724061913-project-member] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 960.071269] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 960.072069] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.072069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.072069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.072681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.072813] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.072866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.072945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.073133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.073222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.073326] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.440878] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd71eef3-fdb4-4293-8cf4-077891626874 in Status: SUCCESS [ 960.441489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.442445] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.442883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.443102] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.443296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.443425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.443696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.443931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.444030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.444209] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd71eef3-fdb4-4293-8cf4-077891626874',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.471919] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.472131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.472363] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.472711] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.473042] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.473255] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.473406] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.473673] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.473860] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.474124] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.474276] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.475180] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.475180] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.475180] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.475180] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.475180] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.487596] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cced9593-3500-4c12-99da-d35935a142b3: rpc.has_security_group_logging(os_id): False [ 960.501869] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.502238] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.502405] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.502590] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.502990] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-d65d67a6-bddf-4f81-9615-67ee45c2adff taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.503240] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-d65d67a6-bddf-4f81-9615-67ee45c2adff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.503376] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-d65d67a6-bddf-4f81-9615-67ee45c2adff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.503709] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-d65d67a6-bddf-4f81-9615-67ee45c2adff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.503858] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d65d67a6-bddf-4f81-9615-67ee45c2adff',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.512297] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.512658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.512817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.513082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.540749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.541037] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.541187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.541297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.541594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.541732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.542025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.542167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.542236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.542484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.542596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.543086] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.543086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.543991] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.544206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.544367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.544499] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cced9593-3500-4c12-99da-d35935a142b3 is going to be updated. [ 960.576611] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.576709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.576764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.577018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.600284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.600512] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.600512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.600641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.600871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.600986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.601144] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be updated. [ 960.623455] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.623455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.623455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.623455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.623455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.640558] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.640558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.640558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.640558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.640558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.640558] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: IN_PROGRESS for 2s [ 960.668907] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 960.947602] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd71eef3-fdb4-4293-8cf4-077891626874 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.947804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.948085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.948338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.948692] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.948878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.948878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.949453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.949453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.949453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.949614] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd71eef3-fdb4-4293-8cf4-077891626874 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.949614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.949719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.949817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.949957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.950052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.950240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.950304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.950408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.950883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.950883] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd71eef3-fdb4-4293-8cf4-077891626874',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.007502] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.007967] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.007967] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.008428] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.008546] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.008716] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port d65d67a6-bddf-4f81-9615-67ee45c2adff not found, creating... [ 961.009055] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.009292] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.009471] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.009793] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.009972] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.010544] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.010718] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.010862] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.011139] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.011287] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.011439] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: d65d67a6-bddf-4f81-9615-67ee45c2adff is going to be created. [ 961.065234] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.065234] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.065234] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.065234] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.065234] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.065234] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-d65d67a6-bddf-4f81-9615-67ee45c2adff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.452640] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd71eef3-fdb4-4293-8cf4-077891626874: rpc.has_security_group_logging(os_id): False [ 961.475554] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.476618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.476730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.476952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.477087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.477331] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.477453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.477756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.477756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.477881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.478061] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.478224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.478556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.478655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.478751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.478977] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.479099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.479246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.479339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.479431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.479532] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd71eef3-fdb4-4293-8cf4-077891626874 is going to be created. [ 961.564818] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.564818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.564818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.564818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.564818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.579436] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd71eef3-fdb4-4293-8cf4-077891626874 in Status: IN_PROGRESS for 2s [ 961.813541] env[69756]: INFO networking_nsxv3.common.synchronization [req-e2443311-f9cc-4af7-aa11-41ec26a31530 req-2e424fc7-9517-4df8-a223-951170c30e58 service nova] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_rules [ 961.813718] env[69756]: INFO networking_nsxv3.common.synchronization [req-e2443311-f9cc-4af7-aa11-41ec26a31530 req-2e424fc7-9517-4df8-a223-951170c30e58 service nova] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 961.813857] env[69756]: INFO networking_nsxv3.common.synchronization [req-e2443311-f9cc-4af7-aa11-41ec26a31530 req-2e424fc7-9517-4df8-a223-951170c30e58 service nova] Enqueued Resource ID: d65d67a6-bddf-4f81-9615-67ee45c2adff with Priority: HIGHEST for action port [ 961.814105] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_rules [ 961.814231] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 961.814334] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d65d67a6-bddf-4f81-9615-67ee45c2adff with Priority: HIGHEST for action port [ 961.814973] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.818794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.818794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.818975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.819044] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.824112] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.824112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.824112] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d65d67a6-bddf-4f81-9615-67ee45c2adff taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.824112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d65d67a6-bddf-4f81-9615-67ee45c2adff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.824112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d65d67a6-bddf-4f81-9615-67ee45c2adff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.824112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d65d67a6-bddf-4f81-9615-67ee45c2adff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.824112] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d65d67a6-bddf-4f81-9615-67ee45c2adff',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.326467] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.326680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.327363] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d65d67a6-bddf-4f81-9615-67ee45c2adff with status ACTIVE [ 962.327363] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.327363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.327363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.327809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.327809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.327809] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.327915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.327915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.329375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.329375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.329375] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.329375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.329375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.329375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.329375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.329375] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d65d67a6-bddf-4f81-9615-67ee45c2adff is going to be updated. [ 962.356341] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.356538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.356538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.356803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.356954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.357168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d65d67a6-bddf-4f81-9615-67ee45c2adff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.658933] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: SUCCESS [ 962.659292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.682088] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 962.682325] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 deletion is rescheduled due to dependency. [ 962.682466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.682715] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.682969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.683187] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.683358] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.683441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.683620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.683763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.683896] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.190617] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.595702] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd71eef3-fdb4-4293-8cf4-077891626874 in Status: SUCCESS [ 963.596295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.696063] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.198935] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.199166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.199166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.199385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.199482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.199603] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be updated. [ 964.230368] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.230544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.230654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.230909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.231119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.243396] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 966.258549] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 966.258970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.258970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.259248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.259478] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.259602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.259675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.259878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.259997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.260113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.260210] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.763378] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.763378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.763378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.763607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.763857] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.763922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.763962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.764150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.764243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.764334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.764511] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.764615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.764672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.765176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.765319] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.765424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.765539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.765748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.765838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.765924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.766028] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.815221] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 966.815221] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 967.268762] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8de5d68d-6838-4955-ae71-d9dd48c0a125: rpc.has_security_group_logging(os_id): False [ 967.288148] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.288349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.288419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.288707] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.288827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.289199] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.289339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.289442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.289615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.289698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.289906] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.290010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.290080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.290231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.290322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.290524] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.290637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.290693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.290823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.290898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.290999] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be updated. [ 967.358991] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.359262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.359337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.359623] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.359865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.375551] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 969.394015] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 969.395105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.651362] env[69756]: INFO networking_nsxv3.common.synchronization [req-83fcdefa-5346-4caf-8845-f94494755725 req-fc7f8d70-71bc-4fa1-9acf-75573f14970a tempest-ServersTestFqdnHostnames-1788494129 tempest-ServersTestFqdnHostnames-1788494129-project-member] Enqueued Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_members [ 969.651916] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_members [ 969.652225] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdf28d13-db76-40d0-a00d-750f9a74b1d7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.652347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.652410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.652666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.652928] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.652928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.653063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.655232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.655332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.655430] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.113409] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-480 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.114424] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-480" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.114424] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-480" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.114424] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-480" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.114424] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.114691] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.114691] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.114815] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.115347] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.115347] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.115347] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.115552] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.115552] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.116194] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.116194] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.116194] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.138323] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.138546] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 970.138704] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.138924] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-480" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.139260] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-c5c5f816-7efa-4af5-a044-3348d8efd5f2 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.139381] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-c5c5f816-7efa-4af5-a044-3348d8efd5f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.139543] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-c5c5f816-7efa-4af5-a044-3348d8efd5f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.139921] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-c5c5f816-7efa-4af5-a044-3348d8efd5f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.141832] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5c5f816-7efa-4af5-a044-3348d8efd5f2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.157567] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.157567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.157567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.159382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.159382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.159382] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.159382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.159653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.159653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.159775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.159876] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 already deleted. [ 970.160013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.645022] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.645022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.645022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.645022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.645022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.645022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port c5c5f816-7efa-4af5-a044-3348d8efd5f2 not found, creating... [ 970.645022] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.645022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.645022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.645022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.645022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.645760] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.645760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.647055] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.647347] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.647612] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.647678] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: c5c5f816-7efa-4af5-a044-3348d8efd5f2 is going to be created. [ 970.674543] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.674848] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.674989] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.675956] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.676252] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.676507] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-c5c5f816-7efa-4af5-a044-3348d8efd5f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.546436] env[69756]: INFO networking_nsxv3.common.synchronization [req-83fcdefa-5346-4caf-8845-f94494755725 req-ceb125d8-4e88-4f12-a1a7-0029019e3d6b service nova] Enqueued Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_rules [ 971.546630] env[69756]: INFO networking_nsxv3.common.synchronization [req-83fcdefa-5346-4caf-8845-f94494755725 req-ceb125d8-4e88-4f12-a1a7-0029019e3d6b service nova] Enqueued Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_members [ 971.546768] env[69756]: INFO networking_nsxv3.common.synchronization [req-83fcdefa-5346-4caf-8845-f94494755725 req-ceb125d8-4e88-4f12-a1a7-0029019e3d6b service nova] Enqueued Resource ID: c5c5f816-7efa-4af5-a044-3348d8efd5f2 with Priority: HIGHEST for action port [ 971.547010] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_rules [ 971.547190] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_members [ 971.547254] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c5f816-7efa-4af5-a044-3348d8efd5f2 with Priority: HIGHEST for action port [ 971.547835] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.547941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.548016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.551692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.552535] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.555112] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdf28d13-db76-40d0-a00d-750f9a74b1d7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.555226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.555384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.555686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.555686] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.555804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.555804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.556091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.556091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.556955] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.559117] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5c5f816-7efa-4af5-a044-3348d8efd5f2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.559385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5c5f816-7efa-4af5-a044-3348d8efd5f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.559524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5c5f816-7efa-4af5-a044-3348d8efd5f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.559772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5c5f816-7efa-4af5-a044-3348d8efd5f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.560225] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5c5f816-7efa-4af5-a044-3348d8efd5f2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.064591] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.065687] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdf28d13-db76-40d0-a00d-750f9a74b1d7 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.065857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.065973] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5c5f816-7efa-4af5-a044-3348d8efd5f2 with status ACTIVE [ 972.066139] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.066254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.066323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.066536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.066648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.066784] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.066880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.066936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.067099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.067179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.067352] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.067446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.067562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.068573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.068656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.068933] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5c5f816-7efa-4af5-a044-3348d8efd5f2 is going to be updated. [ 972.094554] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.094697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.094770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.094978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.095126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.095291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5c5f816-7efa-4af5-a044-3348d8efd5f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.175775] env[69756]: INFO networking_nsxv3.common.synchronization [req-77105c32-16c5-4fdd-8426-ca07813550ed req-7ff96af9-289f-4b07-9d7b-c7c25f15ccb4 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_members [ 972.177129] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_members [ 972.177614] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.177791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.177891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.178506] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.178756] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.179120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.179230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.179589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.179903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.180056] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.552669] env[69756]: INFO networking_nsxv3.common.synchronization [req-e3c48328-238c-48a1-b675-9354ba810639 req-4d64650b-c928-4a8d-a194-0d08320aff1e tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 972.553208] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 972.553510] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.554104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.554104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.554104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.554104] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.554392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.554392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.554392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.554481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.554511] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.571800] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.685126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.685126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.685126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.685126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.685126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.685126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.685126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.685126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.685126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.685126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.685126] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17111ea1-decc-4289-b6f5-8ab312a62032 already deleted. [ 972.685126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.909817] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.910030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.910158] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.910579] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.910894] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.916511] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.916511] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.916511] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.916511] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.916685] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.916840] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.916890] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.916974] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.917073] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.917176] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.917310] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.937866] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.938089] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.938455] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.938455] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.938772] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.938963] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.939065] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.939946] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.940221] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.058963] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.058963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.058963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.058963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.058963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.058963] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.058963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.058963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.058963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.058963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.058963] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 973.077054] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.077054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.077054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.077054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.077054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.077054] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 is going to be created. [ 973.095212] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.095212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.095212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.095212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.095212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.103560] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 973.109826] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.110038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.110118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.110338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.110499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.125099] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 in Status: UNINITIALIZED for 2s [ 973.319594] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e48be1e2-f9d4-4afa-911d-44ebef543a7b None None] Enqueued Resource ID: 857d91ca-5e13-42b7-af5e-5d7dd831479f with Priority: HIGHEST for action port [ 973.319854] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857d91ca-5e13-42b7-af5e-5d7dd831479f with Priority: HIGHEST for action port [ 973.320504] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-857d91ca-5e13-42b7-af5e-5d7dd831479f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.320630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-857d91ca-5e13-42b7-af5e-5d7dd831479f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.320679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-857d91ca-5e13-42b7-af5e-5d7dd831479f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.320971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-857d91ca-5e13-42b7-af5e-5d7dd831479f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.322163] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('857d91ca-5e13-42b7-af5e-5d7dd831479f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.443025] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.443207] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.443248] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.443519] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.443674] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.443862] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec not found, creating... [ 973.444114] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.444278] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.444426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.444626] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.444764] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.445075] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.445214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.445342] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.445700] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.445700] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.445820] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec is going to be created. [ 973.469286] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.469286] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.469286] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.469286] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.469286] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.469286] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.826595] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 857d91ca-5e13-42b7-af5e-5d7dd831479f [ 973.826595] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.826595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.826595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.826595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.826595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.826595] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:857d91ca-5e13-42b7-af5e-5d7dd831479f already deleted. [ 973.826595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-857d91ca-5e13-42b7-af5e-5d7dd831479f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.275432] env[69756]: INFO networking_nsxv3.common.synchronization [req-77105c32-16c5-4fdd-8426-ca07813550ed req-7801237d-bc38-427c-83b0-1fb364615091 service nova] Enqueued Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_rules [ 974.275732] env[69756]: INFO networking_nsxv3.common.synchronization [req-77105c32-16c5-4fdd-8426-ca07813550ed req-7801237d-bc38-427c-83b0-1fb364615091 service nova] Enqueued Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_members [ 974.275732] env[69756]: INFO networking_nsxv3.common.synchronization [req-77105c32-16c5-4fdd-8426-ca07813550ed req-7801237d-bc38-427c-83b0-1fb364615091 service nova] Enqueued Resource ID: adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec with Priority: HIGHEST for action port [ 974.276877] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_rules [ 974.276877] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_members [ 974.276877] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec with Priority: HIGHEST for action port [ 974.276877] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.276877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.277415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.277415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.277415] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.278574] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.278695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.278763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.278939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.279457] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.279589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.279665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.279822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.279907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.280008] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.280756] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.280859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.280930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.281878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.281951] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.783714] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.783844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.784059] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.784971] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec with status ACTIVE [ 974.785184] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.785347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.785476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.785708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.785805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.785988] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.786098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.786158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.786305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.786382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.786568] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.786662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.786719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.786972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.786972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.787244] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec is going to be updated. [ 974.812184] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.812184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.812184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.812184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.812184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.812184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adb46f1a-8b87-4fcc-84d6-e0c1302cf3ec" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.116182] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 975.116182] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 deletion is rescheduled due to dependency. [ 975.116182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.139740] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 in Status: UNINITIALIZED for 4s [ 975.291306] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.298302] env[69756]: INFO networking_nsxv3.common.synchronization [None req-c8d99906-0539-46cd-9168-80fc78e7ac66 None None] Enqueued Resource ID: 39cfec70-14a5-4765-b5cc-90b316837f86 with Priority: HIGHEST for action port [ 975.298302] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39cfec70-14a5-4765-b5cc-90b316837f86 with Priority: HIGHEST for action port [ 975.298302] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-39cfec70-14a5-4765-b5cc-90b316837f86 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.298302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39cfec70-14a5-4765-b5cc-90b316837f86" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.298302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39cfec70-14a5-4765-b5cc-90b316837f86" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.298302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39cfec70-14a5-4765-b5cc-90b316837f86" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.298933] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39cfec70-14a5-4765-b5cc-90b316837f86',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.738511] env[69756]: INFO networking_nsxv3.common.synchronization [req-58657650-0c0b-4454-8fd9-c286291942d2 req-1817e627-741e-4ef0-b78d-bf7b3f0ea756 tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 975.739772] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 975.742651] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.742651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.742651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.742651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.742651] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.742651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.742651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.742651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.742651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.742651] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.793448] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.796734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.796734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.796734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.796734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.796734] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17111ea1-decc-4289-b6f5-8ab312a62032 is going to be created. [ 975.802163] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39cfec70-14a5-4765-b5cc-90b316837f86 [ 975.802163] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.802163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.802163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.802163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.802163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.802163] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39cfec70-14a5-4765-b5cc-90b316837f86 already deleted. [ 975.802163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39cfec70-14a5-4765-b5cc-90b316837f86" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.822533] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.822533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.822808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.822808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.822925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.837243] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17111ea1-decc-4289-b6f5-8ab312a62032 in Status: UNINITIALIZED for 2s [ 976.244548] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.244708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.244783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.245022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.269414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.269670] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.269800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.269859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.271494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.271494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.271494] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 976.291789] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.292183] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.292183] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.292382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.292661] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.292818] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.292937] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.293398] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.294514] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.296779] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.296779] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.296779] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.296947] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.297023] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.297085] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.297228] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.312248] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.312490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.312490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.312697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.312844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.324288] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.324483] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 976.324593] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.324773] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.325110] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-064a8889-a817-49d1-aa90-2c8e0e1b13e0 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.325293] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-064a8889-a817-49d1-aa90-2c8e0e1b13e0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.325406] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-064a8889-a817-49d1-aa90-2c8e0e1b13e0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.325795] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-064a8889-a817-49d1-aa90-2c8e0e1b13e0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.325933] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('064a8889-a817-49d1-aa90-2c8e0e1b13e0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.333289] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 976.833093] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.833516] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.833516] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.833809] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.833934] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.834128] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 064a8889-a817-49d1-aa90-2c8e0e1b13e0 not found, creating... [ 976.834479] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.834572] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.834635] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.834950] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.835128] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.836087] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.836087] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.836087] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.836087] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.836087] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.836249] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 064a8889-a817-49d1-aa90-2c8e0e1b13e0 is going to be created. [ 976.858402] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.858402] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.858402] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.858402] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.858755] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.858789] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-064a8889-a817-49d1-aa90-2c8e0e1b13e0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.009391] env[69756]: INFO networking_nsxv3.common.synchronization [req-7d494eef-f6a8-435f-886d-8c57ffe0f1b2 req-841f64f4-970f-4af9-bb94-9994de0093bc tempest-ServerTagsTestJSON-43809088 tempest-ServerTagsTestJSON-43809088-project-member] Enqueued Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGHEST for action security_group_members [ 977.011227] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGHEST for action security_group_members [ 977.011649] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd71eef3-fdb4-4293-8cf4-077891626874 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.011649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.011805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.015021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.015021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.015021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.015021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.015021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.015021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.015021] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd71eef3-fdb4-4293-8cf4-077891626874',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.149717] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 in Status: SUCCESS [ 977.149717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.149940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.150215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.150490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.150685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.150899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.151598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.151697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.151817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.152022] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.516052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.516488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.516853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.517200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.517356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.517689] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.517849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.517944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.518233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.518367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.518586] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd71eef3-fdb4-4293-8cf4-077891626874 is going to be updated. [ 977.554026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.554230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.554369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.554575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.554764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.567610] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd71eef3-fdb4-4293-8cf4-077891626874 in Status: IN_PROGRESS for 2s [ 977.621474] env[69756]: INFO networking_nsxv3.common.synchronization [req-58657650-0c0b-4454-8fd9-c286291942d2 req-c5442c07-a3e0-4dd0-83fd-2e85540d8658 service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 977.621618] env[69756]: INFO networking_nsxv3.common.synchronization [req-58657650-0c0b-4454-8fd9-c286291942d2 req-c5442c07-a3e0-4dd0-83fd-2e85540d8658 service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 977.621755] env[69756]: INFO networking_nsxv3.common.synchronization [req-58657650-0c0b-4454-8fd9-c286291942d2 req-c5442c07-a3e0-4dd0-83fd-2e85540d8658 service nova] Enqueued Resource ID: 064a8889-a817-49d1-aa90-2c8e0e1b13e0 with Priority: HIGHEST for action port [ 977.622010] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 977.622231] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 977.622312] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 064a8889-a817-49d1-aa90-2c8e0e1b13e0 with Priority: HIGHEST for action port [ 977.623396] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.623581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.623613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.623876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.623987] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.625033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.625199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.625517] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-064a8889-a817-49d1-aa90-2c8e0e1b13e0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.625639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-064a8889-a817-49d1-aa90-2c8e0e1b13e0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.625709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-064a8889-a817-49d1-aa90-2c8e0e1b13e0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.625959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-064a8889-a817-49d1-aa90-2c8e0e1b13e0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.626057] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('064a8889-a817-49d1-aa90-2c8e0e1b13e0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.654575] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.846061] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17111ea1-decc-4289-b6f5-8ab312a62032 in Status: SUCCESS [ 977.846283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.846414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.846678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.846884] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.847015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.847086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.847268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.847355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.847444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.847535] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.128450] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.128450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.130262] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 064a8889-a817-49d1-aa90-2c8e0e1b13e0 with status ACTIVE [ 978.130262] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.130262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.130262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.130446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.130446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.130596] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.130688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.130791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.130956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.131043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.131227] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.131341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.131416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.131567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.131638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.131883] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 064a8889-a817-49d1-aa90-2c8e0e1b13e0 is going to be updated. [ 978.158306] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdf28d13-db76-40d0-a00d-750f9a74b1d7: rpc.has_security_group_logging(os_id): False [ 978.160424] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.160581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.160661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.160921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.161074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.161251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-064a8889-a817-49d1-aa90-2c8e0e1b13e0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.197337] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.197337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.197337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.197337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.197337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.197772] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.197772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.197772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.197989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.198155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.198256] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 is going to be created. [ 978.318029] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.318029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.318029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.318029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.318029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.336323] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 in Status: IN_PROGRESS for 2s [ 978.343920] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 978.346025] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a deletion is rescheduled due to dependency. [ 978.346025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.346025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.346025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.346025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.346025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.346025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.346025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.346025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.346025] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.349246] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.474254] env[69756]: INFO networking_nsxv3.common.synchronization [req-a064914b-c7b8-4da7-bf37-427100ff410d req-002e3b8f-7711-4a2d-8ac7-652534362ca6 tempest-ListImageFiltersTestJSON-1966339438 tempest-ListImageFiltersTestJSON-1966339438-project-member] Enqueued Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 978.477018] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 978.477018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.477018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.477018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.477018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.477018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.477450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.479194] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.479194] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.479194] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.479194] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.682510] env[69756]: INFO networking_nsxv3.common.synchronization [req-91d63d07-7f52-473e-b697-07a7155db594 req-21e7d78d-c0a1-49b2-ad5b-2af41059eabd tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 978.683203] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 978.684236] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.684236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.684236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.684236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.684236] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.684236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.684978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.684978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.684978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.684978] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.851509] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.852907] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17111ea1-decc-4289-b6f5-8ab312a62032: rpc.has_security_group_logging(os_id): False [ 978.877218] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.877218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.877218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.877531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.877531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.877702] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.877796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.878216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.878216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.878216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.878216] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17111ea1-decc-4289-b6f5-8ab312a62032 is going to be created. [ 978.947970] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.947970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.947970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.948284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.948457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.966317] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17111ea1-decc-4289-b6f5-8ab312a62032 in Status: IN_PROGRESS for 2s [ 978.982836] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.187446] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.187630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.187710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.188030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.188156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.188467] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.188623] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.188689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.188867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.188967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.189042] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 already deleted. [ 979.189123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.238189] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.238401] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.238562] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.238896] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.239174] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.239361] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.239495] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.239756] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.239905] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.240524] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.240655] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.240772] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.240883] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.241014] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.241129] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.241273] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.267026] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.267026] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.267026] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.267026] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.267026] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-1801ffda-c176-4b1a-89fb-5e4df2d377bb taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.267026] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-1801ffda-c176-4b1a-89fb-5e4df2d377bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.267026] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-1801ffda-c176-4b1a-89fb-5e4df2d377bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.267026] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-1801ffda-c176-4b1a-89fb-5e4df2d377bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.267026] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1801ffda-c176-4b1a-89fb-5e4df2d377bb',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.358985] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.490513] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.581246] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd71eef3-fdb4-4293-8cf4-077891626874 in Status: SUCCESS [ 979.581246] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd71eef3-fdb4-4293-8cf4-077891626874 deletion is rescheduled due to dependency. [ 979.581246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.768687] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.769066] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.769066] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.769359] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.769504] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.769666] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 1801ffda-c176-4b1a-89fb-5e4df2d377bb not found, creating... [ 979.769933] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.770110] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.770223] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.770467] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.770568] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.770850] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.771019] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.771217] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.771431] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.771623] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.771812] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 1801ffda-c176-4b1a-89fb-5e4df2d377bb is going to be created. [ 979.793668] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.797040] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.797040] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.797040] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.797040] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.797040] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-1801ffda-c176-4b1a-89fb-5e4df2d377bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.861696] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.861865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.861940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.863594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.863755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.863899] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 979.899192] env[69756]: INFO networking_nsxv3.common.synchronization [req-f6e59d56-ae45-48a8-9c79-c18f97b58938 req-2aa1196b-41e3-45a9-b01f-45010e7d3bf8 tempest-ImagesOneServerTestJSON-77063127 tempest-ImagesOneServerTestJSON-77063127-project-member] Enqueued Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGHEST for action security_group_members [ 979.901118] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.901118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.901118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.901118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.901118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.902712] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGHEST for action security_group_members [ 979.903157] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b44dcd-979b-48b6-b98c-52c13fee616a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.903291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.903346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.903552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.903765] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.903888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.903975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.904222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.904325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.904443] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0b44dcd-979b-48b6-b98c-52c13fee616a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.922787] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 979.994659] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.994659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.994659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.994659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.994659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.994659] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 is going to be updated. [ 980.035718] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.036157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.036157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.036389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.036671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.049070] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: IN_PROGRESS for 2s [ 980.348675] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 in Status: SUCCESS [ 980.348928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.406819] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.406983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.407086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.407387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.407558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.407681] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.407817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.407916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.408125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.408224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.408318] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0b44dcd-979b-48b6-b98c-52c13fee616a is going to be updated. [ 980.440961] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.441140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.441213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.441425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.441570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.450667] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0b44dcd-979b-48b6-b98c-52c13fee616a in Status: IN_PROGRESS for 2s [ 980.606179] env[69756]: INFO networking_nsxv3.common.synchronization [req-91d63d07-7f52-473e-b697-07a7155db594 req-cd4720f6-57f2-454a-a815-97cf00cc7dd6 service nova] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_rules [ 980.606179] env[69756]: INFO networking_nsxv3.common.synchronization [req-91d63d07-7f52-473e-b697-07a7155db594 req-cd4720f6-57f2-454a-a815-97cf00cc7dd6 service nova] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 980.606179] env[69756]: INFO networking_nsxv3.common.synchronization [req-91d63d07-7f52-473e-b697-07a7155db594 req-cd4720f6-57f2-454a-a815-97cf00cc7dd6 service nova] Enqueued Resource ID: 1801ffda-c176-4b1a-89fb-5e4df2d377bb with Priority: HIGHEST for action port [ 980.606179] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_rules [ 980.606179] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 980.606179] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1801ffda-c176-4b1a-89fb-5e4df2d377bb with Priority: HIGHEST for action port [ 980.606179] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.606179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.606179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.606179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.606179] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.607859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.608254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.609606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.609875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.610218] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.610218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.610357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.610437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.610535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.610633] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.614349] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1801ffda-c176-4b1a-89fb-5e4df2d377bb taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.614349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1801ffda-c176-4b1a-89fb-5e4df2d377bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.614349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1801ffda-c176-4b1a-89fb-5e4df2d377bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.614349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1801ffda-c176-4b1a-89fb-5e4df2d377bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.614349] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1801ffda-c176-4b1a-89fb-5e4df2d377bb',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.978572] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17111ea1-decc-4289-b6f5-8ab312a62032 in Status: SUCCESS [ 980.978572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.121027] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.121027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.121027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.121027] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1801ffda-c176-4b1a-89fb-5e4df2d377bb with status ACTIVE [ 981.121027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.121027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.121027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.121027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.121027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.121718] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.121718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.121718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.121718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.121718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.121718] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.122026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.122026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.122026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.126362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.126362] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1801ffda-c176-4b1a-89fb-5e4df2d377bb is going to be updated. [ 981.174785] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.174980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.175096] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.175980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.175980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.175980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1801ffda-c176-4b1a-89fb-5e4df2d377bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.511024] env[69756]: INFO networking_nsxv3.common.synchronization [req-538fdc6a-baef-47d1-adb8-fb7159df0df5 req-6d0b62a4-7151-46c4-af83-9f8a1a3ef785 tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 981.511024] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 981.511453] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.511453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.511453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.511620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.511804] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.511915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.511915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.512032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.512115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.512207] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.627646] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.931276] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.931276] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.931276] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.931276] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.931276] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.931276] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.931276] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.931564] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.931596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.931870] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.932221] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.932360] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.932502] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.932791] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.932953] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.933177] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.934932] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 981.935134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.935736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.935961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.936189] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.936332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.936416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.936613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.936722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.936835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.936953] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.960482] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.961026] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 981.961026] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.961378] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.961769] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.961964] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.962162] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.962508] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.962680] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf1334a-81ee-4fa6-8923-20ead10c2ebe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.016045] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.060448] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: SUCCESS [ 982.060693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.131722] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.131905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.131969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.132314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.132419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.132544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 is going to be created. [ 982.165118] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.165118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.165118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.165118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.165118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.177294] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: UNINITIALIZED for 2s [ 982.442195] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.442195] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.442195] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.442195] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.442195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.442813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.442813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.442813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.442813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.442813] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.463307] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0b44dcd-979b-48b6-b98c-52c13fee616a in Status: SUCCESS [ 982.463938] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0b44dcd-979b-48b6-b98c-52c13fee616a deletion is rescheduled due to dependency. [ 982.464324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.465201] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.465619] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.465864] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.466330] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.466658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.466936] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port dbf1334a-81ee-4fa6-8923-20ead10c2ebe not found, creating... [ 982.467442] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.467818] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.468066] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.468873] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.469153] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.469757] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.470501] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.470788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.471178] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.472783] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.472783] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: dbf1334a-81ee-4fa6-8923-20ead10c2ebe is going to be created. [ 982.503491] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.503879] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.504072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.504366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.504614] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.504876] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.516624] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.945303] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48c09f21-41e5-4def-8d66-8a36711be55a: rpc.has_security_group_logging(os_id): False [ 982.966290] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.966290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.966290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.966290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.966290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.966290] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.966290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.966290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.966290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.966290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.966772] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.966772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.966772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.966772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.966772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.966924] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.966970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.967009] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.967172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.967243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.967356] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 983.019024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.019296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.019296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.019362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.019447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.019550] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 983.030569] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.030780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.030780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.030995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.031170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.042971] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 983.055209] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.055209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.055209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.055209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.055209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.064156] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 983.261782] env[69756]: INFO networking_nsxv3.common.synchronization [req-538fdc6a-baef-47d1-adb8-fb7159df0df5 req-71e74385-700c-465b-8d41-1b442e108d49 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 983.261988] env[69756]: INFO networking_nsxv3.common.synchronization [req-538fdc6a-baef-47d1-adb8-fb7159df0df5 req-71e74385-700c-465b-8d41-1b442e108d49 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 983.262113] env[69756]: INFO networking_nsxv3.common.synchronization [req-538fdc6a-baef-47d1-adb8-fb7159df0df5 req-71e74385-700c-465b-8d41-1b442e108d49 service nova] Enqueued Resource ID: dbf1334a-81ee-4fa6-8923-20ead10c2ebe with Priority: HIGHEST for action port [ 983.262353] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 983.262486] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 983.262581] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf1334a-81ee-4fa6-8923-20ead10c2ebe with Priority: HIGHEST for action port [ 983.263194] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.263361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.263470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.263739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.263847] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.265153] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.265267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.265465] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.265570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.265662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.265821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.265902] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf1334a-81ee-4fa6-8923-20ead10c2ebe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.767372] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.767624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.767705] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbf1334a-81ee-4fa6-8923-20ead10c2ebe with status ACTIVE [ 983.767872] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.768027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.768301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.768301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.768379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.768512] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.768665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.768729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.768901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.769038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.769159] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.769260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.769319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.769465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.769589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.769774] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbf1334a-81ee-4fa6-8923-20ead10c2ebe is going to be updated. [ 983.793253] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.793253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.793253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.793519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.794128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.794128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbf1334a-81ee-4fa6-8923-20ead10c2ebe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.186724] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: SUCCESS [ 984.187024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.187170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.188766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.188996] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.189154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.189225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.189402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.189488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.190195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.190195] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.694251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.694397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.694467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.696224] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.696224] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.696224] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.696224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.696775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.696775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.696775] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.825225] env[69756]: INFO networking_nsxv3.common.synchronization [req-6767b4d6-46f3-4f4a-abd1-6b086ac0924f req-32af5d4a-4cf9-4947-9936-d8bd2c7dcfdb tempest-ServersNegativeTestMultiTenantJSON-437843829 tempest-ServersNegativeTestMultiTenantJSON-437843829-project-member] Enqueued Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGHEST for action security_group_members [ 984.825619] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGHEST for action security_group_members [ 984.826297] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e669f6b-9b7b-497e-9670-1ddbd9860754 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.826297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.826297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.826475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.828233] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.828373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.828445] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.828708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.828802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.828918] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e669f6b-9b7b-497e-9670-1ddbd9860754',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.993581] env[69756]: INFO networking_nsxv3.common.synchronization [req-27feaa6d-6ad4-497f-8f7b-6868c328cdbc req-8958049b-f760-4601-8224-d24179cb937b tempest-ImagesOneServerNegativeTestJSON-724061913 tempest-ImagesOneServerNegativeTestJSON-724061913-project-member] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 984.993581] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 984.993821] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.994591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.994591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.994591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.995279] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.995721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.995933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.998932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.998932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.998932] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.060576] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 985.060830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.074746] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 985.075100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.075783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.076046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.076556] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.076556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.079959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.080253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.080443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.080443] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.201556] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 867f2d31-4611-4fd9-ab17-4761f9cc8675: rpc.has_security_group_logging(os_id): False [ 985.224743] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.225184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.225184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.225440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.225513] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.225841] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.226068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.226136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.226324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.226406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.226746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.226904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.226972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.227662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.227829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.228100] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.228100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.228209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.228331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.228421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.228496] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 is going to be created. [ 985.308439] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.308439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.308439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.308439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.308439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.322506] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: IN_PROGRESS for 2s [ 985.331755] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.332034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.332134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.332414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.332842] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.334233] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.334422] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.334953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.334953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.334953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.334953] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 already deleted. [ 985.334953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.502222] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.502376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.502698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.502765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.502811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.503024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.503129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.503197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.503354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.503431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.503517] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be updated. [ 985.547615] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.547818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.547887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.548145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.548311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.558522] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 985.584751] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.623716] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-857 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.623913] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-857" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.624053] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-857" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.624405] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-857" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.628088] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.628823] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.628823] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.628823] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.628988] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.629131] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.629247] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.629394] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.629461] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.629574] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.629721] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.629878] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.651113] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.651265] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 985.651431] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.651617] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-857" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.651928] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-0a0ac015-7254-475b-86e6-679ca8a744b6 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.652112] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-0a0ac015-7254-475b-86e6-679ca8a744b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.652233] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-0a0ac015-7254-475b-86e6-679ca8a744b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.652547] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-0a0ac015-7254-475b-86e6-679ca8a744b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.652686] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a0ac015-7254-475b-86e6-679ca8a744b6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.091947] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.154848] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.155129] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.155273] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.155552] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.155727] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.155984] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 0a0ac015-7254-475b-86e6-679ca8a744b6 not found, creating... [ 986.156238] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.156499] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.156657] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.156888] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.157083] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.157392] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.157549] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.157762] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.157917] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.158100] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.158252] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 0a0ac015-7254-475b-86e6-679ca8a744b6 is going to be created. [ 986.185469] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.185724] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.185832] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.186354] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.186454] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.186640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-0a0ac015-7254-475b-86e6-679ca8a744b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.597623] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.598066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.598401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.598801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.598934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.598994] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 986.635052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.635052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.635052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.635052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.635052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.644562] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 986.975813] env[69756]: INFO networking_nsxv3.common.synchronization [req-6767b4d6-46f3-4f4a-abd1-6b086ac0924f req-5d48230a-f78a-4e2e-91ca-b0e26f40b2ce service nova] Enqueued Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGHEST for action security_group_rules [ 986.977847] env[69756]: INFO networking_nsxv3.common.synchronization [req-6767b4d6-46f3-4f4a-abd1-6b086ac0924f req-5d48230a-f78a-4e2e-91ca-b0e26f40b2ce service nova] Enqueued Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGHEST for action security_group_members [ 986.978124] env[69756]: INFO networking_nsxv3.common.synchronization [req-6767b4d6-46f3-4f4a-abd1-6b086ac0924f req-5d48230a-f78a-4e2e-91ca-b0e26f40b2ce service nova] Enqueued Resource ID: 0a0ac015-7254-475b-86e6-679ca8a744b6 with Priority: HIGHEST for action port [ 986.978554] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGHEST for action security_group_rules [ 986.978796] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGHEST for action security_group_members [ 986.978916] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a0ac015-7254-475b-86e6-679ca8a744b6 with Priority: HIGHEST for action port [ 986.979703] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e669f6b-9b7b-497e-9670-1ddbd9860754 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.979703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.979703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.979703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.979935] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e669f6b-9b7b-497e-9670-1ddbd9860754',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.980694] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e669f6b-9b7b-497e-9670-1ddbd9860754 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.980766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.980807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.981021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.981194] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.981289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.981354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.981510] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.981594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.982174] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e669f6b-9b7b-497e-9670-1ddbd9860754',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.984272] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a0ac015-7254-475b-86e6-679ca8a744b6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.984470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a0ac015-7254-475b-86e6-679ca8a744b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.984470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a0ac015-7254-475b-86e6-679ca8a744b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.986111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a0ac015-7254-475b-86e6-679ca8a744b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.986111] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a0ac015-7254-475b-86e6-679ca8a744b6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.121862] env[69756]: INFO networking_nsxv3.common.synchronization [req-477a89f8-ce98-4ef8-a27d-57ee6eac7650 req-e87fcce0-f10a-4047-9d93-349abc35644a tempest-ServersAdminNegativeTestJSON-1545143736 tempest-ServersAdminNegativeTestJSON-1545143736-project-member] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 987.122454] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 987.122996] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.123140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.123201] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.123403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.123793] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.123793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.123793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.123948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.123948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.124017] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.332674] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: SUCCESS [ 987.332970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.488525] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e669f6b-9b7b-497e-9670-1ddbd9860754 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.488525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.488525] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e669f6b-9b7b-497e-9670-1ddbd9860754',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.490202] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a0ac015-7254-475b-86e6-679ca8a744b6 with status ACTIVE [ 987.490202] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.490202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.490489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.491895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.491895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.492107] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.492107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.492217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.492348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.492453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.492695] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.492777] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.492813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.493060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.493226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.493288] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a0ac015-7254-475b-86e6-679ca8a744b6 is going to be updated. [ 987.505981] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.506327] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.506556] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.507142] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.507571] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.508133] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.508357] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.509032] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.509252] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.509701] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.509896] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.510533] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.510770] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.511016] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.511258] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.511516] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.535178] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.535178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.535178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.535178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.535178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.535178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a0ac015-7254-475b-86e6-679ca8a744b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.544970] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.545863] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 987.545863] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.545991] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-458" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.546390] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-72de9f68-8901-4adb-87f1-4223e77a2f54 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.546678] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-72de9f68-8901-4adb-87f1-4223e77a2f54" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.546981] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-72de9f68-8901-4adb-87f1-4223e77a2f54" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.549039] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-72de9f68-8901-4adb-87f1-4223e77a2f54" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.549039] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72de9f68-8901-4adb-87f1-4223e77a2f54',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.578531] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 987.578700] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 deletion is rescheduled due to dependency. [ 987.578842] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.627016] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.996283] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e669f6b-9b7b-497e-9670-1ddbd9860754',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.051392] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.051614] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.051729] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.054167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.054167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.054167] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 72de9f68-8901-4adb-87f1-4223e77a2f54 not found, creating... [ 988.054167] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.054167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.054167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.054167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.054167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.054167] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.054167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.054937] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.054937] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.054937] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.054937] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 72de9f68-8901-4adb-87f1-4223e77a2f54 is going to be created. [ 988.075475] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.075742] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.076029] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.076409] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.076821] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.077505] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-72de9f68-8901-4adb-87f1-4223e77a2f54" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.130356] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.502960] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.503169] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.503223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.503482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.503599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.503642] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 is going to be created. [ 988.537490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.537753] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.537944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.538245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.538481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.552238] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 in Status: UNINITIALIZED for 2s [ 988.635151] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.635803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.635803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.635803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.636048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.636048] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf is going to be updated. [ 988.653856] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 988.654146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.654366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.654633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.654890] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.655114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.655155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.655361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.655473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.655606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.655743] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.666531] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.667329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.667329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.667329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.667529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.678989] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: IN_PROGRESS for 2s [ 988.898948] env[69756]: INFO networking_nsxv3.common.synchronization [req-477a89f8-ce98-4ef8-a27d-57ee6eac7650 req-a101c66e-7a35-4783-8b8c-0c6aee29307c service nova] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_rules [ 988.898948] env[69756]: INFO networking_nsxv3.common.synchronization [req-477a89f8-ce98-4ef8-a27d-57ee6eac7650 req-a101c66e-7a35-4783-8b8c-0c6aee29307c service nova] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 988.902897] env[69756]: INFO networking_nsxv3.common.synchronization [req-477a89f8-ce98-4ef8-a27d-57ee6eac7650 req-a101c66e-7a35-4783-8b8c-0c6aee29307c service nova] Enqueued Resource ID: 72de9f68-8901-4adb-87f1-4223e77a2f54 with Priority: HIGHEST for action port [ 988.902897] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_rules [ 988.902897] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 988.902897] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72de9f68-8901-4adb-87f1-4223e77a2f54 with Priority: HIGHEST for action port [ 988.902897] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.902897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.902897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.902897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.902897] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.909022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.909022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.909022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-72de9f68-8901-4adb-87f1-4223e77a2f54 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.909022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72de9f68-8901-4adb-87f1-4223e77a2f54" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.909022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72de9f68-8901-4adb-87f1-4223e77a2f54" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.909022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72de9f68-8901-4adb-87f1-4223e77a2f54" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.909022] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72de9f68-8901-4adb-87f1-4223e77a2f54',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.158199] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.158462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.158540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.158887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.159221] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.159416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.159416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.159659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.159815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.159975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.160241] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.160387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.160498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.160712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.160884] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.160979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.161062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.161266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.161359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.161460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.161557] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.411523] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72de9f68-8901-4adb-87f1-4223e77a2f54 with status ACTIVE [ 989.411733] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.411885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.412132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.412220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.412315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.412534] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.412648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.412721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.412883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.412961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.413154] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.413249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.413316] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.413461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.413568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.413655] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72de9f68-8901-4adb-87f1-4223e77a2f54 is going to be updated. [ 989.415162] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.415162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.438125] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.438310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.438386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.438608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.438961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.439348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72de9f68-8901-4adb-87f1-4223e77a2f54" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.666919] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8feed-cd04-49d0-9fbe-c89808cf758f: rpc.has_security_group_logging(os_id): False [ 989.685737] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.686455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.686844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.694025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.711936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.715388] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.715388] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.715388] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.715388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.715958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.715958] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 989.786430] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.789168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.789168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.789168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.789168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.807123] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 990.044611] env[69756]: INFO networking_nsxv3.common.synchronization [req-0cff784c-07f5-46b9-a8b4-c7441452868a req-8475ba6f-c1e9-4af5-a56a-0e41ee1688fa tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 990.045354] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 990.045802] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.046651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.046651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.046651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.046651] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.046651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.046651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.046920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.047485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.047485] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.193928] env[69756]: INFO networking_nsxv3.common.synchronization [None req-d77ada2f-c576-4403-9bf3-cdde865639b6 None None] Enqueued Resource ID: ded79921-355f-46c6-a382-d931c3a3574c with Priority: HIGHEST for action port [ 990.195328] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded79921-355f-46c6-a382-d931c3a3574c with Priority: HIGHEST for action port [ 990.195766] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ded79921-355f-46c6-a382-d931c3a3574c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.196058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ded79921-355f-46c6-a382-d931c3a3574c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.196140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ded79921-355f-46c6-a382-d931c3a3574c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.196750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ded79921-355f-46c6-a382-d931c3a3574c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.196891] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ded79921-355f-46c6-a382-d931c3a3574c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.553212] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.553479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.553562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.553921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.554031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.554259] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.554372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.554435] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.554640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.554746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.554857] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 990.567973] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 in Status: SUCCESS [ 990.568130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.568296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.568511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.568723] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.568885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.568959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.569141] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.569217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.569322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.569413] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e669f6b-9b7b-497e-9670-1ddbd9860754',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.599184] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.599392] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.599504] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.599778] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.600043] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.600208] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.600344] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.600599] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.600712] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.600917] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.601189] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.601388] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.601515] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.601636] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.601745] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.601883] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.603828] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.603933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.604035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.604269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.608099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.617560] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 990.627745] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.627928] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.628079] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.628260] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.628587] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-0aad5bcf-407f-40bb-8f08-f831b08e01f2 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.628808] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-0aad5bcf-407f-40bb-8f08-f831b08e01f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.628936] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-0aad5bcf-407f-40bb-8f08-f831b08e01f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.629337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-0aad5bcf-407f-40bb-8f08-f831b08e01f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.629480] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aad5bcf-407f-40bb-8f08-f831b08e01f2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.689925] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: SUCCESS [ 990.690188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.690341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.690569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.690739] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.690867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.690943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.693346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.693346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.693346] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.704223] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ded79921-355f-46c6-a382-d931c3a3574c [ 990.704223] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.704223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.704223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.704223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.704223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.704223] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ded79921-355f-46c6-a382-d931c3a3574c already deleted. [ 990.704223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ded79921-355f-46c6-a382-d931c3a3574c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.080160] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e669f6b-9b7b-497e-9670-1ddbd9860754 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.080160] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.080160] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e669f6b-9b7b-497e-9670-1ddbd9860754 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.080160] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.080160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.080929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.080929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.080929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.080929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.080929] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e669f6b-9b7b-497e-9670-1ddbd9860754',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.132523] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.133450] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.133450] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.133450] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.134967] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.134967] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 0aad5bcf-407f-40bb-8f08-f831b08e01f2 not found, creating... [ 991.134967] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.134967] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.134967] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.134967] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.134967] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.139401] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.139640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.139763] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.140195] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.140375] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.140534] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 0aad5bcf-407f-40bb-8f08-f831b08e01f2 is going to be created. [ 991.183375] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.183375] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.183375] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.183375] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.183375] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.183648] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-0aad5bcf-407f-40bb-8f08-f831b08e01f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.197079] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.585284] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e669f6b-9b7b-497e-9670-1ddbd9860754: rpc.has_security_group_logging(os_id): False [ 991.607116] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.607296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.607365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.607572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.607663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.607903] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.608046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.608091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.608262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.608342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.608565] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.608658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.608772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.608970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.608970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.610098] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.610227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.610294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.610474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.610584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.610685] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 is going to be created. [ 991.679641] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.679793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.679853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.680125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.680313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.695318] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 in Status: IN_PROGRESS for 2s [ 991.701836] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.822617] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 991.822908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.037348] env[69756]: INFO networking_nsxv3.common.synchronization [req-0cff784c-07f5-46b9-a8b4-c7441452868a req-4c88fc20-5d1a-4920-bfa3-1057924bc25c service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 992.037348] env[69756]: INFO networking_nsxv3.common.synchronization [req-0cff784c-07f5-46b9-a8b4-c7441452868a req-4c88fc20-5d1a-4920-bfa3-1057924bc25c service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 992.037348] env[69756]: INFO networking_nsxv3.common.synchronization [req-0cff784c-07f5-46b9-a8b4-c7441452868a req-4c88fc20-5d1a-4920-bfa3-1057924bc25c service nova] Enqueued Resource ID: 0aad5bcf-407f-40bb-8f08-f831b08e01f2 with Priority: HIGHEST for action port [ 992.037348] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 992.037348] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 992.037348] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aad5bcf-407f-40bb-8f08-f831b08e01f2 with Priority: HIGHEST for action port [ 992.037785] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.037785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.037785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.037935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.038037] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.038946] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.039313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.039313] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aad5bcf-407f-40bb-8f08-f831b08e01f2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.039500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aad5bcf-407f-40bb-8f08-f831b08e01f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.039500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aad5bcf-407f-40bb-8f08-f831b08e01f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.039755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aad5bcf-407f-40bb-8f08-f831b08e01f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.039842] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aad5bcf-407f-40bb-8f08-f831b08e01f2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.205326] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.205533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.205619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.206233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.206340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.207599] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf is going to be updated. [ 992.244384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.244562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.244562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.244759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.244853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.255240] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: IN_PROGRESS for 2s [ 992.336188] env[69756]: INFO networking_nsxv3.common.synchronization [None req-12c1d2b1-88e0-440d-bf2f-7391a4e0d604 None None] Enqueued Resource ID: eef52d59-2d25-48f9-b4f9-30bdc41ce001 with Priority: HIGHEST for action port [ 992.336448] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef52d59-2d25-48f9-b4f9-30bdc41ce001 with Priority: HIGHEST for action port [ 992.337282] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-eef52d59-2d25-48f9-b4f9-30bdc41ce001 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.337393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eef52d59-2d25-48f9-b4f9-30bdc41ce001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.337393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eef52d59-2d25-48f9-b4f9-30bdc41ce001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.337754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eef52d59-2d25-48f9-b4f9-30bdc41ce001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.337754] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eef52d59-2d25-48f9-b4f9-30bdc41ce001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.413445] env[69756]: INFO networking_nsxv3.common.synchronization [None req-f4f214d8-2338-4eaf-81b8-17364186297b tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 992.413445] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 992.416595] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.417388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.417602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.418056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.418285] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.483103] env[69756]: INFO networking_nsxv3.common.synchronization [req-44f01d56-5aba-47ee-8e02-280f526e90e3 req-b769e1b2-8871-43b1-b02a-c0464105c6c7 tempest-ServersWithSpecificFlavorTestJSON-311311506 tempest-ServersWithSpecificFlavorTestJSON-311311506-project-member] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 992.483904] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 992.484812] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.484812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.484812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.485035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.485035] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.485143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.485182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.485619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.485722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.485823] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.542801] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.542951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.543218] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0aad5bcf-407f-40bb-8f08-f831b08e01f2 with status ACTIVE [ 992.543440] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.543572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.543643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.543851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.543945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.544122] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.544221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.544300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.544474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.544557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.544738] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.544835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.544896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.545048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.545120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.546022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0aad5bcf-407f-40bb-8f08-f831b08e01f2 is going to be updated. [ 992.561914] env[69756]: INFO networking_nsxv3.common.synchronization [None req-0fd88742-f119-472b-b3d9-ccb2bbac1a0b tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 992.562552] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 992.563077] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.563077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.593088] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.593263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.593360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.593708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.593931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.594135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aad5bcf-407f-40bb-8f08-f831b08e01f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.632240] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 992.633071] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 992.633071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.633636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.633979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.634151] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.634284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.634401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.634557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.634636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.634784] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.842567] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eef52d59-2d25-48f9-b4f9-30bdc41ce001 [ 992.843117] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.843117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.843117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.843470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.843470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.843533] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eef52d59-2d25-48f9-b4f9-30bdc41ce001 already deleted. [ 992.843583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eef52d59-2d25-48f9-b4f9-30bdc41ce001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.954249] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.954814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.954814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.954946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.954946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.955134] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc already deleted. [ 992.956511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.956917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.957301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.957578] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.992154] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.992154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.992154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.992154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.018424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.018424] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.018424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.018424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.018424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.018424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.018424] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 is going to be updated. [ 993.059077] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.059252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.059436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.059782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.060031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.074766] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: IN_PROGRESS for 2s [ 993.140232] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.486731] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.486731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.486731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.486731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.487186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.487186] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc already deleted. [ 993.487334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.644798] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.712246] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 in Status: SUCCESS [ 993.712515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.149939] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.150360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.150360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.151584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.151584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.151584] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 994.187201] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.187344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.187431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.187917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.188312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.192619] env[69756]: INFO networking_nsxv3.common.synchronization [req-edff9404-b6a4-4034-8d41-f20115628700 req-1e69a257-982e-4c38-9dde-7d1c604d15b8 tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 994.193242] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 994.194788] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.194788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.194788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.194788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.194788] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.194788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.194788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.194788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.194788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.194788] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.200772] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 994.267592] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: SUCCESS [ 994.267895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.268157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.268441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.268997] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.269160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.269160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.269318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.269400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.269545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.269608] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.701346] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.701346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.701346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.701346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.701346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.701346] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.701346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.701346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.701346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.701346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.701346] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 994.741936] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.741936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.741936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.741936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.741936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.753557] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 994.774717] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.774717] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.774717] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.774717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.775459] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.775459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.775459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.775459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.775459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.775459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.775787] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.782315] env[69756]: INFO networking_nsxv3.common.synchronization [req-df9396d0-7376-4ed1-bbbd-5b480b85bacf req-b4ab71d5-099c-4749-ad28-cd793646a54a tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 994.783854] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 994.785957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.786161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.786262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.786525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.786732] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.786886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.787119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.787195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.787246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.787407] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.986848] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.987079] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.987240] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.987554] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.987846] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.988061] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.988169] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.988350] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.988498] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.988848] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.988981] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.989330] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.989330] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.989330] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.989471] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.989579] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.027901] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.027901] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 995.027901] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.027901] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.027901] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.027901] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.027901] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.028248] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.028248] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3ceffb2-d1bd-46a2-9c09-a30e7a402588',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.087967] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: SUCCESS [ 995.088082] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 deletion is rescheduled due to dependency. [ 995.088185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.278606] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf: rpc.has_security_group_logging(os_id): False [ 995.294739] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.298359] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.298359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.298359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.298359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.298359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.298359] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.298999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.299249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.299665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.299934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.300284] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.303029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.303029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.303029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.303029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.303029] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.303029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.303029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.303029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.303029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.303029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf is going to be updated. [ 995.390054] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.390299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.390363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.390528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.390702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.414300] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: IN_PROGRESS for 2s [ 995.531107] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.531361] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.531488] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.531934] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.532190] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.532352] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port c3ceffb2-d1bd-46a2-9c09-a30e7a402588 not found, creating... [ 995.532635] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.532799] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.532919] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.533257] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.533414] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.533705] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.533889] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.535298] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.535676] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.535970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.536221] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: c3ceffb2-d1bd-46a2-9c09-a30e7a402588 is going to be created. [ 995.576676] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.577062] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.577062] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.577628] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.577628] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.577894] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.804537] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.212728] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 996.212975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.213152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.213300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.213515] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.213641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.213706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.214031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.214130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.214228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.214328] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.307731] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.307731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.307731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.308267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.308267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.308267] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 996.340298] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.340499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.340499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.340764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.340857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.354708] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 996.374900] env[69756]: INFO networking_nsxv3.common.synchronization [req-edff9404-b6a4-4034-8d41-f20115628700 req-7e0b9726-952c-4df2-bb83-97f70a3e23cb service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 996.375139] env[69756]: INFO networking_nsxv3.common.synchronization [req-edff9404-b6a4-4034-8d41-f20115628700 req-7e0b9726-952c-4df2-bb83-97f70a3e23cb service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 996.375247] env[69756]: INFO networking_nsxv3.common.synchronization [req-edff9404-b6a4-4034-8d41-f20115628700 req-7e0b9726-952c-4df2-bb83-97f70a3e23cb service nova] Enqueued Resource ID: c3ceffb2-d1bd-46a2-9c09-a30e7a402588 with Priority: HIGHEST for action port [ 996.375908] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 996.377593] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 996.377832] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ceffb2-d1bd-46a2-9c09-a30e7a402588 with Priority: HIGHEST for action port [ 996.380032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.380032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.380032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.380032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.380032] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.381788] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.381788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.381788] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.381788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.381788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.382121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.382235] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3ceffb2-d1bd-46a2-9c09-a30e7a402588',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.716720] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.716868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.716961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.717381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.717696] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.717696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.717696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.717919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.718032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.718128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.718377] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.718455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.718488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.718633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.718770] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.718949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.719042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.719205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.719281] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.719369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.719460] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.766342] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 996.766519] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 deletion is rescheduled due to dependency. [ 996.766855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.766855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.767150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.767480] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.767589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.767645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.767807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.767896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.768044] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.886407] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.886609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.886792] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3ceffb2-d1bd-46a2-9c09-a30e7a402588 with status ACTIVE [ 996.886981] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.887111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.887205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.887383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.887473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.887645] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.887741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.887803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.887964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.888055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.888233] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.888326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.888427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.888588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.888658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.888736] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3ceffb2-d1bd-46a2-9c09-a30e7a402588 is going to be updated. [ 996.917452] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.920695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.920695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.920695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.920695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.920695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3ceffb2-d1bd-46a2-9c09-a30e7a402588" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.222850] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d711ed5-98da-4810-9f03-9148ad645008: rpc.has_security_group_logging(os_id): False [ 997.252036] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.252283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.252283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.252517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.252652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.254307] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.254307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.254307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.254307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.254307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.254307] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.254307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.254307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.258439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.258690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.259040] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.259198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.259464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.259464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.259533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.259583] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 997.270839] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.377245] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.377744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.377744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.377744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.377744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.397386] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 997.428282] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: SUCCESS [ 997.428611] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.777455] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.970726] env[69756]: INFO networking_nsxv3.common.synchronization [req-f262b0e9-a071-4f7d-a275-29c959a0dbef req-e892325e-9355-4a8e-bcee-31eb4b44b2be tempest-ServersAdminTestJSON-2109728624 tempest-ServersAdminTestJSON-2109728624-project-member] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 997.971401] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 997.971746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.971894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.972016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.976192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.976438] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.976565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.976639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.976911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.977010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.977142] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.281168] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.281345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.281403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.281685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.281833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.281964] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 998.322273] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.322566] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.322566] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.322755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.322864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.332768] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 998.362518] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 998.362718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.479451] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.982616] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.414196] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 999.414487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.489255] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.489554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.489554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.489750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.489876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.490046] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 999.523322] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.523535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.523602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.523840] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.524264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.534562] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 1000.344441] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1000.344441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.344726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.344926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.345213] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.345293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.345368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.345532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.345618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.345710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.345808] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.848233] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.848664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.848664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.848664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.850353] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.850353] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.850353] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.850353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.851056] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.354424] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8: rpc.has_security_group_logging(os_id): False [ 1001.381866] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.381866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.382275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.382275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.382275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.382514] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.382514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.382833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.382833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.382833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.382981] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.383082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.383138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.383455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.383455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.383606] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.383606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.383730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.383802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.383882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.383954] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1001.454548] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.454745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.454827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.455020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.455182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.465662] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1001.497859] env[69756]: INFO networking_nsxv3.common.synchronization [req-f4dd1ead-5836-4724-a64d-00079fe3fd2a req-0d423db5-b0de-4613-ad41-1f045e41cd15 tempest-ServersNegativeTestMultiTenantJSON-437843829 tempest-ServersNegativeTestMultiTenantJSON-437843829-project-member] Enqueued Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGHEST for action security_group_members [ 1001.498397] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGHEST for action security_group_members [ 1001.499346] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e669f6b-9b7b-497e-9670-1ddbd9860754 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.499346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.499780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.500103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.500290] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.500434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.500545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.500658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.500765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.500885] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e669f6b-9b7b-497e-9670-1ddbd9860754',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.549252] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 1001.549513] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.004764] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.005245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.005245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.005245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.005352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.005493] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.005598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.005667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.007082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.007082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.007082] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 is going to be updated. [ 1002.037316] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.037532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.037532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.037765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.037928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.048367] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 in Status: IN_PROGRESS for 2s [ 1002.162071] env[69756]: INFO networking_nsxv3.common.synchronization [req-f35c984b-0086-46e9-aed8-e7383b8b2da9 req-c41b1750-7d2d-4ebc-ab5f-a5227249abb5 tempest-FloatingIPsAssociationTestJSON-1590966768 tempest-FloatingIPsAssociationTestJSON-1590966768-project-member] Enqueued Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1002.162853] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1002.163485] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.163630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.163690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.164892] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.165124] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.165248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.165313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.165590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.165745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.165854] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.668716] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.668972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.669110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.669400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.669520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.669772] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.669967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.670064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.670244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.670332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.670445] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e923000-de4f-4614-8d9f-829896824884 already deleted. [ 1002.670630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.701914] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.701914] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-805" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.701914] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-805" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.703049] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-805" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.703049] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.703049] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.703219] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.703632] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.703947] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.704252] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.704412] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.704571] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.704775] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.704997] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.705177] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.705366] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.735060] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.735318] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.735510] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.735783] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-805" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.736350] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.736580] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.736710] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.737096] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.737224] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d4f8d3c-9edc-4b3b-8a0a-a10764b00515',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.240894] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.241289] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.241484] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.241874] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.242115] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.242353] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 9d4f8d3c-9edc-4b3b-8a0a-a10764b00515 not found, creating... [ 1003.242733] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.242971] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.243199] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.243548] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.243802] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.244212] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.244454] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.244643] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.244953] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.245181] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.245404] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 9d4f8d3c-9edc-4b3b-8a0a-a10764b00515 is going to be created. [ 1003.266397] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.266681] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.266842] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.267122] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.267399] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.267688] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.485313] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1003.485477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.060418] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 in Status: SUCCESS [ 1004.060418] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 deletion is rescheduled due to dependency. [ 1004.060418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.119190] env[69756]: INFO networking_nsxv3.common.synchronization [req-f35c984b-0086-46e9-aed8-e7383b8b2da9 req-ba24b5ea-e677-4f63-a452-1fb239b1d3b9 service nova] Enqueued Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_rules [ 1004.119190] env[69756]: INFO networking_nsxv3.common.synchronization [req-f35c984b-0086-46e9-aed8-e7383b8b2da9 req-ba24b5ea-e677-4f63-a452-1fb239b1d3b9 service nova] Enqueued Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1004.119963] env[69756]: INFO networking_nsxv3.common.synchronization [req-f35c984b-0086-46e9-aed8-e7383b8b2da9 req-ba24b5ea-e677-4f63-a452-1fb239b1d3b9 service nova] Enqueued Resource ID: 9d4f8d3c-9edc-4b3b-8a0a-a10764b00515 with Priority: HIGHEST for action port [ 1004.123957] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_rules [ 1004.123957] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1004.123957] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d4f8d3c-9edc-4b3b-8a0a-a10764b00515 with Priority: HIGHEST for action port [ 1004.123957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.123957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.123957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.123957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.123957] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.123957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.123957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.123957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.123957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.123957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.124453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.124453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.124592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.124626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.124911] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.125472] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.125631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.125631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.125788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.125914] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d4f8d3c-9edc-4b3b-8a0a-a10764b00515',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.630866] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.630866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.630866] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.630866] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d4f8d3c-9edc-4b3b-8a0a-a10764b00515 with status ACTIVE [ 1004.630866] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.630866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.630866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.630866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.630866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.630866] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.630866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.630866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.630866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.631665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.636319] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.636449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.636516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.636709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.636788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.637912] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d4f8d3c-9edc-4b3b-8a0a-a10764b00515 is going to be updated. [ 1004.663932] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.663932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.663932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.664157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.664157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.664308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d4f8d3c-9edc-4b3b-8a0a-a10764b00515" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.138974] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.644754] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.644754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.644754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.644754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.644754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.644754] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e923000-de4f-4614-8d9f-829896824884 is going to be created. [ 1005.678034] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.678256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.678455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.678507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.679264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.699182] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: UNINITIALIZED for 2s [ 1006.679425] env[69756]: INFO networking_nsxv3.common.synchronization [req-9c88cb38-a21f-423b-a172-1388d4da237b req-5454e343-ce98-41f8-89a1-dd96f2199e04 tempest-VolumesAssistedSnapshotsTest-1545684772 tempest-VolumesAssistedSnapshotsTest-1545684772-project-member] Enqueued Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_members [ 1006.679977] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGHEST for action security_group_members [ 1006.680301] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fd17e7b-8910-4529-a801-b80ed3d29a0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.680426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.680500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.680689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.680845] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.680947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.681014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.682587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.682738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.682845] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.771518] env[69756]: INFO networking_nsxv3.common.synchronization [req-18bac1b1-fca4-4ec2-8693-82361a3cf157 req-b477242c-71f0-4c9c-9293-3287e232b5e7 tempest-ServersAdminNegativeTestJSON-1545143736 tempest-ServersAdminNegativeTestJSON-1545143736-project-member] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 1006.772169] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 1006.772707] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.772911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.773135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.773861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.774466] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.775109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.775109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.777028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.777245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.777245] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.187823] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.187823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.187823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.187823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.232624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.232915] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.233050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.233116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.233581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.234110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.234110] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e is going to be updated. [ 1007.268662] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.269085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.269085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.269297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.269297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.279423] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e in Status: IN_PROGRESS for 2s [ 1007.282882] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.709593] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: SUCCESS [ 1007.710053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.710279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.710533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.710735] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.710853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.710920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.711097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.711183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.711271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.711361] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.786015] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.214520] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.214520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.214520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.214953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.215197] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.215362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.215457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.215901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.215901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.215901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.216167] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.216443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.216443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.216570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.216716] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.216868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.216933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.217264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.217374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.217522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.217641] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.290100] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.290336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.290431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.290651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.290761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.290860] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf is going to be updated. [ 1008.322947] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.323158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.323215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.323467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.323547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.337478] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: IN_PROGRESS for 2s [ 1008.512867] env[69756]: INFO networking_nsxv3.common.synchronization [req-a1a95d49-a3e9-498f-92cc-2cd5e646af63 req-3aa58233-c6c5-41fe-ac01-cae2ede54eea tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1008.517037] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1008.517037] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.517520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.517520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.517520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.517642] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.517692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.517728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.518444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.518444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.518444] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.720680] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e923000-de4f-4614-8d9f-829896824884: rpc.has_security_group_logging(os_id): False [ 1008.745087] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.745330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.745429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.745709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.746130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.746130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.746293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.746357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.746513] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.746629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.746890] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.747046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.747114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.747426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.747783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.748048] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.748164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.748242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.748441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.748557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.748714] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e923000-de4f-4614-8d9f-829896824884 is going to be created. [ 1008.835213] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.835439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.835489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.835811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.836156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.872596] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: IN_PROGRESS for 2s [ 1009.023739] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.023896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.023988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.024756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.024756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.024756] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.024756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.024986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.025053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.025159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.025287] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1009.060487] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.060652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.060705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.060932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.061080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.073970] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1009.289747] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e in Status: SUCCESS [ 1009.289903] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e deletion is rescheduled due to dependency. [ 1009.290010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.348717] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: SUCCESS [ 1010.349128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.425986] env[69756]: INFO networking_nsxv3.common.synchronization [req-bfb0a1eb-0307-454d-a6f9-e5377855bda6 req-ba48255d-349e-4a4b-bdaf-bd40b56d288e tempest-ListImageFiltersTestJSON-1966339438 tempest-ListImageFiltersTestJSON-1966339438-project-member] Enqueued Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 1010.427021] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGHEST for action security_group_members [ 1010.427021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.430049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.430049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.430049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.430049] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.430049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.430049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.430049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.430049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.430049] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.888219] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: SUCCESS [ 1010.888508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.931761] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.931923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.931996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.932253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.963289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.963575] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.963710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.963788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.964016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.964115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.964221] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 is going to be updated. [ 1011.003476] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.004053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.004053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.004689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.004689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.014983] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: IN_PROGRESS for 2s [ 1011.083924] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1011.083924] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a deletion is rescheduled due to dependency. [ 1011.083924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.448589] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.448937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.448937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.449105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.449232] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.952423] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.268409] env[69756]: INFO networking_nsxv3.common.synchronization [req-f5b67d57-957b-4565-af11-82ce7ec9fbfc req-16867d7a-f6d5-4924-9b7a-320b279db578 tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 1012.269096] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 1012.270602] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.270602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.270602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.270602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.270602] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.271116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.271116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.271116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.271116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.271361] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.459235] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.774153] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.774419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.774419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.774686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.774765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.775030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.775155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.775225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.775413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.775498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.775590] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 is going to be updated. [ 1012.808786] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.808944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.809046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.809284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.809448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.823170] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: IN_PROGRESS for 2s [ 1012.966209] env[69756]: INFO networking_nsxv3.common.synchronization [req-cf62dc49-9d4a-49a9-9917-47d6b80cbb53 req-2dbbe02b-3fc5-4d4d-9b1b-382393444a5b tempest-MultipleCreateTestJSON-821679604 tempest-MultipleCreateTestJSON-821679604-project-member] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1012.966209] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1012.966209] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1012.967411] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1012.967734] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.967857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.967921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.968180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.969237] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.969237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.969237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.969237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.969237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.969237] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.174455] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 in Status: SUCCESS [ 1013.174666] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 deletion is rescheduled due to dependency. [ 1013.174788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.416067] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.416360] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.416493] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.416774] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.417995] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.417995] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.418313] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.418559] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.418739] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.419109] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.419241] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.419360] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.419471] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.419611] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.419738] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.419885] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.446308] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.446771] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.446771] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.446897] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.447865] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-fae116ea-d578-44a1-a029-1ddcfa749d13 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.447865] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-fae116ea-d578-44a1-a029-1ddcfa749d13" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.447865] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-fae116ea-d578-44a1-a029-1ddcfa749d13" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.448600] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-fae116ea-d578-44a1-a029-1ddcfa749d13" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.448600] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fae116ea-d578-44a1-a029-1ddcfa749d13',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.471510] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.471805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.471805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.472537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.474023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.474023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.474023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.474023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.474419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.474419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.474419] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 1013.508369] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.508369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.508369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.508369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.508369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.518144] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 1013.951102] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.951407] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.951811] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.951942] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.952082] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.952276] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port fae116ea-d578-44a1-a029-1ddcfa749d13 not found, creating... [ 1013.952598] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.952771] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.952905] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.953309] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.953426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.953688] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.953841] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.953954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.954509] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.954726] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.954927] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: fae116ea-d578-44a1-a029-1ddcfa749d13 is going to be created. [ 1013.969957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.970173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.970548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.970548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.987135] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1013.988179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.990220] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1013.992106] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.992484] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.992703] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.993066] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.993361] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.993690] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-fae116ea-d578-44a1-a029-1ddcfa749d13" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.102412] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.102671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.102792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.103811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.121209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.121209] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1014.121209] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1014.121209] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1014.179145] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.179309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.179430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.180150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.181930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.181930] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1014.313626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.313626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.313626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.313626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.313626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.313626] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1014.438337] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.438604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.438604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.438773] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.439041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.439392] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 1014.439596] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'85a485c2-7c41-4a10-ae35-986ad49897e2', 'e1505824-b2af-43e9-86e7-eba6fd16c230', '17111ea1-decc-4289-b6f5-8ab312a62032', 'b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf', '30b64bbe-dc6f-49e2-8ffb-8b4a312e2734', 'cced9593-3500-4c12-99da-d35935a142b3', 'd0b44dcd-979b-48b6-b98c-52c13fee616a', '47f4cc8e-dc8b-42c2-a280-bec009884679', '32e225ab-ea84-40a3-8d3c-daef53bb88e8', '88b9f358-c151-4b1c-adb6-6e05b22ab1ce', '1466bf0f-8177-4a39-85ea-b07bc9efb94c', '58d8feed-cd04-49d0-9fbe-c89808cf758f', '48c09f21-41e5-4def-8d66-8a36711be55a', '829189fa-bce1-4609-a296-4d4ca0be554d', 'd34ec2a1-9b82-4a22-adf9-c9f049d563f8', 'aa06de64-a891-4a6e-b4a0-eb1e3a875e9e', '867f2d31-4611-4fd9-ab17-4761f9cc8675', '3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8', '69eeba93-f93f-45ab-9cb2-242c52429094', 'e3bf1989-7e31-4042-8158-612d65438abc', '4d9269ab-57a3-474d-a98c-7ba1583e57fc', '85796156-67df-4d82-b494-0ea64303f9ba', '285c5000-ac60-42b0-8441-f857f98438d0', 'fa5dd68d-835d-4416-ac9f-cab1591b2b82', 'bdf28d13-db76-40d0-a00d-750f9a74b1d7', '7fd17e7b-8910-4529-a801-b80ed3d29a0e', '8e923000-de4f-4614-8d9f-829896824884', '73cf7e80-866c-4475-93d6-8e9e3254cf79', '7d711ed5-98da-4810-9f03-9148ad645008', '49317fc3-59c5-4b8b-a14b-79b0c266a17a', 'dd71eef3-fdb4-4293-8cf4-077891626874', '9e669f6b-9b7b-497e-9670-1ddbd9860754', '8de5d68d-6838-4955-ae71-d9dd48c0a125', '91d49c48-1e8f-4b77-9b74-b8d508a2115b', 'b5f631a6-10e1-4423-9d64-92e1be795a21', '4b6578e8-a78e-4c09-82f2-a7faaacca9bc', 'a6688165-9289-4b4f-a688-1379d300b9cd', '4cae8dc5-dcca-4592-aebe-26bb46462d80', '3669143c-24cd-4014-976c-a88fbc9ce9be'} {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1014.439596] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1014.471325] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.471539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.471539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.471829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.471829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.472024] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1014.472024] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1014.472135] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1014.571635] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.571835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.571891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.573214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.574173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.574529] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1014.574629] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1014.574737] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1014.574737] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1014.575128] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 1014.575128] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGH for action security_group_rules [ 1014.575128] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGH for action security_group_rules [ 1014.575128] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGH for action security_group_rules [ 1014.575288] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGH for action security_group_rules [ 1014.575288] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGH for action security_group_rules [ 1014.575410] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGH for action security_group_rules [ 1014.575410] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGH for action security_group_rules [ 1014.575503] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGH for action security_group_rules [ 1014.575503] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGH for action security_group_rules [ 1014.575627] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGH for action security_group_rules [ 1014.575627] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGH for action security_group_rules [ 1014.575753] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGH for action security_group_rules [ 1014.575753] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGH for action security_group_rules [ 1014.575753] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGH for action security_group_rules [ 1014.575946] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGH for action security_group_rules [ 1014.575946] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGH for action security_group_rules [ 1014.575946] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGH for action security_group_rules [ 1014.576054] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGH for action security_group_rules [ 1014.576054] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGH for action security_group_rules [ 1014.576118] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGH for action security_group_rules [ 1014.576198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.833912] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: SUCCESS [ 1014.833912] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 deletion is rescheduled due to dependency. [ 1014.833912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.875383] env[69756]: INFO networking_nsxv3.common.synchronization [req-cf62dc49-9d4a-49a9-9917-47d6b80cbb53 req-27050b73-db26-41b2-859d-1beb32c7779c service nova] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_rules [ 1014.875753] env[69756]: INFO networking_nsxv3.common.synchronization [req-cf62dc49-9d4a-49a9-9917-47d6b80cbb53 req-27050b73-db26-41b2-859d-1beb32c7779c service nova] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1014.876023] env[69756]: INFO networking_nsxv3.common.synchronization [req-cf62dc49-9d4a-49a9-9917-47d6b80cbb53 req-27050b73-db26-41b2-859d-1beb32c7779c service nova] Enqueued Resource ID: fae116ea-d578-44a1-a029-1ddcfa749d13 with Priority: HIGHEST for action port [ 1014.877509] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_rules [ 1014.878955] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1014.879218] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae116ea-d578-44a1-a029-1ddcfa749d13 with Priority: HIGHEST for action port [ 1014.881033] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGH for action security_group_rules [ 1014.881033] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGH for action security_group_rules [ 1014.881033] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b44dcd-979b-48b6-b98c-52c13fee616a with Priority: HIGH for action security_group_rules [ 1014.881033] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGH for action security_group_rules [ 1014.881033] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bf1989-7e31-4042-8158-612d65438abc with Priority: HIGH for action security_group_rules [ 1014.881033] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69eeba93-f93f-45ab-9cb2-242c52429094 with Priority: HIGH for action security_group_rules [ 1014.881033] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGH for action security_group_rules [ 1014.881332] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGH for action security_group_rules [ 1014.881332] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829189fa-bce1-4609-a296-4d4ca0be554d with Priority: HIGH for action security_group_rules [ 1014.881332] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e with Priority: HIGH for action security_group_rules [ 1014.881332] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGH for action security_group_rules [ 1014.881587] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGH for action security_group_rules [ 1014.881587] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c with Priority: HIGH for action security_group_rules [ 1014.881587] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce with Priority: HIGH for action security_group_rules [ 1014.881692] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 with Priority: HIGH for action security_group_rules [ 1014.881692] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGH for action security_group_rules [ 1014.881767] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGH for action security_group_rules [ 1014.885024] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGH for action security_group_rules [ 1014.885024] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1505824-b2af-43e9-86e7-eba6fd16c230 with Priority: HIGH for action security_group_rules [ 1014.885024] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGH for action security_group_rules [ 1014.885024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.885024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.885024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.885024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.885024] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.885024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.885024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.885024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-fae116ea-d578-44a1-a029-1ddcfa749d13 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.885024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fae116ea-d578-44a1-a029-1ddcfa749d13" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.885024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fae116ea-d578-44a1-a029-1ddcfa749d13" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.885832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fae116ea-d578-44a1-a029-1ddcfa749d13" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.885832] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fae116ea-d578-44a1-a029-1ddcfa749d13',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.885962] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.886192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.886192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.886377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.886660] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.887697] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.887822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.887896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.888067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.888185] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.888809] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0b44dcd-979b-48b6-b98c-52c13fee616a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.888944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.888979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.890178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.890178] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0b44dcd-979b-48b6-b98c-52c13fee616a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.890516] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.890584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.890722] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3bf1989-7e31-4042-8158-612d65438abc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.890868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.890935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.892652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.892777] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3bf1989-7e31-4042-8158-612d65438abc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.893728] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69eeba93-f93f-45ab-9cb2-242c52429094 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.894080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.895957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.896131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.896235] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69eeba93-f93f-45ab-9cb2-242c52429094',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.897138] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.897283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.897357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.897481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.897596] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.903214] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.903384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.903969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.904322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.904465] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.905624] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-829189fa-bce1-4609-a296-4d4ca0be554d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.905805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.909021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.909021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.909021] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('829189fa-bce1-4609-a296-4d4ca0be554d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.909021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.909021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.909021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.909021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.909021] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa06de64-a891-4a6e-b4a0-eb1e3a875e9e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.909021] env[69756]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 1014.909021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.909021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.909021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.909021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.909021] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.910205] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.910617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.910723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.910906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.911022] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.912474] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.912610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.912747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.912925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.913197] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1466bf0f-8177-4a39-85ea-b07bc9efb94c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.914043] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.914200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.914288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.914592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.914669] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88b9f358-c151-4b1c-adb6-6e05b22ab1ce',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.915789] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.916140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.916140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.916263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.916263] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32e225ab-ea84-40a3-8d3c-daef53bb88e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.918258] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.918258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.918258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.918258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.918258] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.918470] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.918704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.918704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.918831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.918922] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.919882] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.920028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.920090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.920295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.920425] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.921885] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1505824-b2af-43e9-86e7-eba6fd16c230 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.921992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.923016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.923016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.923016] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1505824-b2af-43e9-86e7-eba6fd16c230',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.923953] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.923953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.923953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.924348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.924348] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.924693] env[69756]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1014.928833] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.929028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.929155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.929461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.933017] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.933017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.933017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.933017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.933017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.933017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.933017] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.933737] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.933930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.934028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.934220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.934693] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.934693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.934693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.934831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.935052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.935052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.935158] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.939242] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fae116ea-d578-44a1-a029-1ddcfa749d13 with status ACTIVE [ 1014.939491] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.939818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.940597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.940597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.940597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.940597] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.941073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.941153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.941339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.941449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.942053] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.942122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.942303] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.942367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.942469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.942579] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fae116ea-d578-44a1-a029-1ddcfa749d13 is going to be updated. [ 1014.944203] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.944327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.976365] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.976644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.976644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.976813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.976956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.977138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fae116ea-d578-44a1-a029-1ddcfa749d13" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.115415] env[69756]: INFO networking_nsxv3.common.synchronization [req-91608802-4a3d-4aaf-8e07-b6ca8f872f7e req-a404bcd6-0746-4a21-a49e-22a0ac0bd470 tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1015.115415] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1015.116045] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.116045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.116045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.116045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.116295] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.116295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.116402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.116493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.116577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.116669] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.449484] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.453033] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.477122] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.477122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.477599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.477599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.477742] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.477742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.477824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.478211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.478211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.478211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.478211] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.483783] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.483783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.483783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.483783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.484026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.484451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.484451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.484651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.484721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.484812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.484909] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.493628] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.493806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.493902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.494317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.494458] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.494738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.494738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.494864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.494864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.494963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.495032] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.495997] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.495997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.496256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.496256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.496363] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.500124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.500124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.500124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.500124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.500124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.500124] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.503052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.503404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.503404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.503567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.503631] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.504160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.504271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.504381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.504463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.504547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.504628] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.519188] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.519462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.519462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.519662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.524367] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.524630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.566743] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.566952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.567859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.567961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.568752] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.568857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.569935] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.569935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.571024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.571141] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.572032] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 1015.572569] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 deletion is rescheduled due to dependency. [ 1015.572697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.573449] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.573586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.574274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.574274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.574274] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.574440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.574502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.574624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.574703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.574804] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.576529] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.576617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.577423] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.577541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.578230] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.578360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.578968] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1015.579816] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.579816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.580393] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1015.580831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.580961] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69eeba93-f93f-45ab-9cb2-242c52429094 is going to be deleted. [ 1015.582477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.582676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.607320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.607727] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be deleted. [ 1015.608983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.608983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.618876] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.619034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.637876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.638087] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3bf1989-7e31-4042-8158-612d65438abc is going to be deleted. [ 1015.639259] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.639512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.642411] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.642591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.672102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.672102] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88b9f358-c151-4b1c-adb6-6e05b22ab1ce is going to be deleted. [ 1015.672518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.672690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.693039] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.693039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.700282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.700477] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32e225ab-ea84-40a3-8d3c-daef53bb88e8 is going to be deleted. [ 1015.701633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.701889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.738555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.738773] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1466bf0f-8177-4a39-85ea-b07bc9efb94c is going to be deleted. [ 1015.741075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.742222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.763418] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.763777] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.767539] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.767764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.781361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.781948] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa06de64-a891-4a6e-b4a0-eb1e3a875e9e is going to be deleted. [ 1015.783692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.783692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.810588] env[69756]: INFO networking_nsxv3.common.synchronization [req-cf62dc49-9d4a-49a9-9917-47d6b80cbb53 req-6d557477-ff19-4501-9fd7-19496245abc3 tempest-MultipleCreateTestJSON-821679604 tempest-MultipleCreateTestJSON-821679604-project-member] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1015.812750] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1015.813320] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.813490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.845762] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.846033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.848053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.848053] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 is going to be deleted. [ 1015.849935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.850257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.895728] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.895728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.904319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.904519] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0b44dcd-979b-48b6-b98c-52c13fee616a is going to be deleted. [ 1015.906889] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.906889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.906889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.906889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.907300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.907300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa06de64-a891-4a6e-b4a0-eb1e3a875e9e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.907300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.907436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.952259] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17111ea1-decc-4289-b6f5-8ab312a62032: rpc.has_security_group_logging(os_id): False [ 1015.954349] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85a485c2-7c41-4a10-ae35-986ad49897e2: rpc.has_security_group_logging(os_id): False [ 1015.981351] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.981644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.981746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.982024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.982259] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.982381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.982446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.982653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.982779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.982884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.983074] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.983196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.983260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.983438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.983601] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.983701] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.983767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.983930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.984022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.984130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.984237] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.991276] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.991276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.991276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.991276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.991276] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.991276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.991276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.991276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.991276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.991276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.992188] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.992188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.992188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.992188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.992188] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.993151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.993279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.993500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.993500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.993680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.993680] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.011250] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.011250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.012788] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.013145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.014845] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.014845] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.014845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.014845] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.015848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.015964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.016166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.016363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.016363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.016630] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.017983] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.018180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.018293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.018471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.018629] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.018715] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.019052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.019052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.019052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.019219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.019303] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.019361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.019421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.019555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.019699] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.019792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.019858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.019986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.020415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.020415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.020415] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.026566] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.026700] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1505824-b2af-43e9-86e7-eba6fd16c230 is going to be deleted. [ 1016.029756] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.029899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.029955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.030209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.030401] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.030505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.030568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.030729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.030810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.030897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.031223] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.031223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.031345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.031644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.031644] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.031644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.031796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.032871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.032871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.032871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.032871] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.033257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.033415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.037467] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.037467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.037467] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.037467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.060449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.060578] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 is going to be deleted. [ 1016.061519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.061764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.084905] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.111143] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.111337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.136239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.136731] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.136731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.136934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.136978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.137086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.137204] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1016.138880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.138880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.138880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.138880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69eeba93-f93f-45ab-9cb2-242c52429094" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.140860] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.141037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.141112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.141306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.141420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.141718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1505824-b2af-43e9-86e7-eba6fd16c230" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.141718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.141861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.141965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.142160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.142641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.142807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.142902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.142998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3bf1989-7e31-4042-8158-612d65438abc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.143279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.143279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.143371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.143461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88b9f358-c151-4b1c-adb6-6e05b22ab1ce" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.143576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.143720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.143796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.143895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1466bf0f-8177-4a39-85ea-b07bc9efb94c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.144037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.144182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.144436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.144436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32e225ab-ea84-40a3-8d3c-daef53bb88e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.144552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.144600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.200183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.201111] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 829189fa-bce1-4609-a296-4d4ca0be554d is going to be deleted. [ 1016.201507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.201804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.204755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.204755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.204755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.204755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.207094] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.207232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.207349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.207511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.207642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.224149] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.224149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.241901] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1016.263825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.264167] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.264305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.264364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.264538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.264622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.264716] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17111ea1-decc-4289-b6f5-8ab312a62032 is going to be updated. [ 1016.266491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.266753] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.266867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.267008] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0b44dcd-979b-48b6-b98c-52c13fee616a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.267212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.267420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.298208] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.298208] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.298208] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.298509] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.298772] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.298942] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.302022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.302022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.302022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.302022] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.302022] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.302022] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.302022] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.302022] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.302022] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.302022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.324846] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e407fb35-8643-4f72-8646-a08f643906c7 None None] Enqueued Resource ID: d6162533-3515-4eda-abda-abaca437e05e with Priority: HIGHEST for action port [ 1016.325148] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6162533-3515-4eda-abda-abaca437e05e with Priority: HIGHEST for action port [ 1016.325949] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6162533-3515-4eda-abda-abaca437e05e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.327464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6162533-3515-4eda-abda-abaca437e05e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.327596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6162533-3515-4eda-abda-abaca437e05e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.327813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6162533-3515-4eda-abda-abaca437e05e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.327902] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6162533-3515-4eda-abda-abaca437e05e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.335641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.335799] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.335889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.336669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.336669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.336669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.336669] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 is going to be updated. [ 1016.339643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.339911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.340023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.340156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.351260] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.351260] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1016.351260] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.351260] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-439" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.351631] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-cc890431-cdde-45bf-9759-f46167528349 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.351885] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-cc890431-cdde-45bf-9759-f46167528349" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.351945] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-cc890431-cdde-45bf-9759-f46167528349" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.352288] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-cc890431-cdde-45bf-9759-f46167528349" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.352427] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc890431-cdde-45bf-9759-f46167528349',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.354777] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.354902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.354968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.355190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.355280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.355393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-829189fa-bce1-4609-a296-4d4ca0be554d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.434769] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.434986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.434986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.435264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.435423] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.454927] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.456939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.457043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.457407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.457577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.475024] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17111ea1-decc-4289-b6f5-8ab312a62032 in Status: IN_PROGRESS for 2s [ 1016.478282] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 in Status: IN_PROGRESS for 2s [ 1016.489204] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8feed-cd04-49d0-9fbe-c89808cf758f: rpc.has_security_group_logging(os_id): False [ 1016.496080] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734: rpc.has_security_group_logging(os_id): False [ 1016.514260] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.514483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.514483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.514681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.525501] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.525741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.525841] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cced9593-3500-4c12-99da-d35935a142b3: rpc.has_security_group_logging(os_id): False [ 1016.531675] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf: rpc.has_security_group_logging(os_id): False [ 1016.535766] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8: rpc.has_security_group_logging(os_id): False [ 1016.554674] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.554674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.554674] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.554674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.555556] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.555646] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.563273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.563537] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.563884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.563960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.564188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.564279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.564503] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.564609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.564676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.564834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.564911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.565104] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.565189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.565245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.565388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.565466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.565563] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1016.566720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.566895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.587456] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.622961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.623363] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.623642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.623642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.623948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.624088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.624401] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.624576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.624664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.625347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.625347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.625764] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.625893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.625987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.626245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.626364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.626501] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 1016.628858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.629170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.659817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.659817] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.659817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.659817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.659817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.660142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.660142] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.660292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.660292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.661406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.661406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.661406] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.661406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.661406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.661406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.661406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.661406] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf is going to be updated. [ 1016.663792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.664143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.687615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.688662] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.688662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.688662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.688662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.688662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.688662] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.688662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.689551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.689551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.689551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.689551] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.689551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.689551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.689551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.689551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.689804] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1016.692798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.692798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.704071] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.704071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.726266] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.726442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.735728] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.735728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.735728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.735728] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.735728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.735728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.736268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.736268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.736474] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.736580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.736643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.736862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.736939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.737153] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.737341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.737341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.737509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.737592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.737721] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cced9593-3500-4c12-99da-d35935a142b3 is going to be updated. [ 1016.738813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.738979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.739192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.741189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.741189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.741189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.742198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.743201] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.743201] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.766063] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 1016.766968] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1016.767772] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: IN_PROGRESS for 2s [ 1016.832229] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.832425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.832425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.832636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.836023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.836023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6162533-3515-4eda-abda-abaca437e05e [ 1016.836023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.836023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.836023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.836023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.836023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.836023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6162533-3515-4eda-abda-abaca437e05e already deleted. [ 1016.836023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6162533-3515-4eda-abda-abaca437e05e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.853449] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1016.859033] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.859033] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.859033] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.859033] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.859033] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.859033] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port cc890431-cdde-45bf-9759-f46167528349 not found, creating... [ 1016.859033] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.859033] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.859033] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.859033] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.859760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.859760] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.859760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.859887] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.860023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.860158] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.860456] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: cc890431-cdde-45bf-9759-f46167528349 is going to be created. [ 1016.902518] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.902812] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.902961] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.903352] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.903689] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.903973] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-cc890431-cdde-45bf-9759-f46167528349" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.916842] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.917047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.917099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.917321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.917476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.949720] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: IN_PROGRESS for 2s [ 1017.092073] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.092073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.092073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.092073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.092073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.092073] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 1017.125983] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.126284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.126284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.126489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.126663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.138224] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 1017.738479] env[69756]: INFO networking_nsxv3.common.synchronization [req-cf62dc49-9d4a-49a9-9917-47d6b80cbb53 req-1bf9eed0-24b7-4418-aa3d-18f827598a19 service nova] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_rules [ 1017.738791] env[69756]: INFO networking_nsxv3.common.synchronization [req-cf62dc49-9d4a-49a9-9917-47d6b80cbb53 req-1bf9eed0-24b7-4418-aa3d-18f827598a19 service nova] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1017.738791] env[69756]: INFO networking_nsxv3.common.synchronization [req-cf62dc49-9d4a-49a9-9917-47d6b80cbb53 req-1bf9eed0-24b7-4418-aa3d-18f827598a19 service nova] Enqueued Resource ID: cc890431-cdde-45bf-9759-f46167528349 with Priority: HIGHEST for action port [ 1017.739660] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_rules [ 1017.739660] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1017.739660] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc890431-cdde-45bf-9759-f46167528349 with Priority: HIGHEST for action port [ 1017.742260] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.742416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.742681] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.742774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.742964] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc890431-cdde-45bf-9759-f46167528349 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.743084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc890431-cdde-45bf-9759-f46167528349" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.743152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc890431-cdde-45bf-9759-f46167528349" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.743409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc890431-cdde-45bf-9759-f46167528349" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.743494] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc890431-cdde-45bf-9759-f46167528349',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.250769] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc890431-cdde-45bf-9759-f46167528349 with status ACTIVE [ 1018.250769] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.250769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.251204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.251204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.251204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.251343] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.252449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.252449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.252449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.252449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.252449] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.252449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.252449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.252449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.252449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.252449] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc890431-cdde-45bf-9759-f46167528349 is going to be updated. [ 1018.254077] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1018.254238] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 1018.254333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.285480] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.285629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.285912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.285912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.286191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.286410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc890431-cdde-45bf-9759-f46167528349" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.491370] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 in Status: SUCCESS [ 1018.491622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.492477] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17111ea1-decc-4289-b6f5-8ab312a62032 in Status: SUCCESS [ 1018.492709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.786936] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: SUCCESS [ 1018.787430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.788085] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 1018.788175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.788845] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1018.794017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.868045] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1018.868418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.966991] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: SUCCESS [ 1018.967293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.104733] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8c77e98c-2325-4538-809b-12777f4ad076 None None] Enqueued Resource ID: e237181f-01e5-4469-a3f1-46536d9673bb with Priority: HIGHEST for action port [ 1019.105323] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e237181f-01e5-4469-a3f1-46536d9673bb with Priority: HIGHEST for action port [ 1019.105642] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e237181f-01e5-4469-a3f1-46536d9673bb taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.105761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e237181f-01e5-4469-a3f1-46536d9673bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.106367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e237181f-01e5-4469-a3f1-46536d9673bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.106644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e237181f-01e5-4469-a3f1-46536d9673bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.106725] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e237181f-01e5-4469-a3f1-46536d9673bb',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.149110] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 4s [ 1019.609851] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e237181f-01e5-4469-a3f1-46536d9673bb [ 1019.610050] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.610232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.610292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.610538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.610646] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.610761] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e237181f-01e5-4469-a3f1-46536d9673bb already deleted. [ 1019.610834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e237181f-01e5-4469-a3f1-46536d9673bb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.009019] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bb9ff77-84f4-4157-b8d6-b0b27174e67c req-7fdb4cf9-963d-48d7-96dc-23a4316e564e tempest-ServersWithSpecificFlavorTestJSON-311311506 tempest-ServersWithSpecificFlavorTestJSON-311311506-project-member] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 1021.009019] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 1021.009019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.009019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.009019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.009019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.009019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.009019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.009019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.009019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.010088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.010088] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.163154] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 1021.163364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.163550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.163786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.163980] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.164115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.164174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.164350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.164437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.164509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.164610] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.166133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.166334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.166517] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.166640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.166702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.166867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.166946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.167259] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.434831] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.435096] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-859" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.435329] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-859" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.435658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-859" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.435987] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.436198] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.436386] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.436653] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.436818] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.437071] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.437193] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.437310] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.437428] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.437561] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.437674] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.437807] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.460651] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.460842] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1021.460992] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.461186] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-859" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.461527] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.461752] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.461881] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.462252] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.462405] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d87571a-e9de-4c5f-ad49-63ee5cccde6c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.513152] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.513152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.513152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.513152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.513638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.513638] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.513638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.513638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.513890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.513985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.514054] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 is going to be deleted. [ 1021.548259] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.548548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.548548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.548755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.548872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.549078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.669322] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.669468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.669672] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.966414] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.966827] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.967074] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.967548] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.967821] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.968151] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 9d87571a-e9de-4c5f-ad49-63ee5cccde6c not found, creating... [ 1021.968623] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.968904] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.969488] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.970443] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.970762] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.971485] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.971906] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.972465] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.972797] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.973075] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.973571] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 9d87571a-e9de-4c5f-ad49-63ee5cccde6c is going to be created. [ 1021.996616] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.996988] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.996988] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.997976] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.997976] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.997976] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.175568] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.241421] env[69756]: INFO networking_nsxv3.common.synchronization [req-d613a47b-9ab7-4298-aacc-fdd78f29a944 req-6cb4dffd-8922-476a-b327-c173528fbb73 tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1022.243226] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1022.243226] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.243439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.243439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.243735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.243963] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.244152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.244268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.244533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.244693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.244866] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.682233] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.682233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.682233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.682233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.682233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.682233] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 1022.751399] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.753017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.753017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.753017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.753017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.756677] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.756677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.756677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.756677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.756677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.756677] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.756677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.756677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.756677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.756677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.756677] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1022.767686] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 1022.791256] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.791256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.791256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.791256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.791256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.800437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1022.832019] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bb9ff77-84f4-4157-b8d6-b0b27174e67c req-2ff89776-4106-46db-86b3-97f5739c9cd7 service nova] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_rules [ 1022.832019] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bb9ff77-84f4-4157-b8d6-b0b27174e67c req-2ff89776-4106-46db-86b3-97f5739c9cd7 service nova] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 1022.832468] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bb9ff77-84f4-4157-b8d6-b0b27174e67c req-2ff89776-4106-46db-86b3-97f5739c9cd7 service nova] Enqueued Resource ID: 9d87571a-e9de-4c5f-ad49-63ee5cccde6c with Priority: HIGHEST for action port [ 1022.836085] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_rules [ 1022.836085] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 1022.836085] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d87571a-e9de-4c5f-ad49-63ee5cccde6c with Priority: HIGHEST for action port [ 1022.836085] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.836085] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.836085] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.836085] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.836085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.837432] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.838742] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.839081] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.839453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.839805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.840072] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d87571a-e9de-4c5f-ad49-63ee5cccde6c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.342822] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.342822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.343180] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.346161] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d87571a-e9de-4c5f-ad49-63ee5cccde6c with status ACTIVE [ 1023.346161] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.346161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.346342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.346880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.346880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.346880] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.346880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.347103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.347103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.347184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.347451] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.347604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.347604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.347711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.348023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.348023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d87571a-e9de-4c5f-ad49-63ee5cccde6c is going to be updated. [ 1023.374804] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.375116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.375116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.375281] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.375413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.375577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d87571a-e9de-4c5f-ad49-63ee5cccde6c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.847542] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.350723] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.351026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.351026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.351482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.351482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.351482] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 is going to be created. [ 1024.386205] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.386371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.386428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.386678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.386843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.397302] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: UNINITIALIZED for 2s [ 1024.778507] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 1024.778507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.778716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.778937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.779144] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.779264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.779356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.779516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.779600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.779698] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.811237] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1024.811237] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 deletion is rescheduled due to dependency. [ 1024.811407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.285453] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.789578] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.292152] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.292152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.292152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.292592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.292592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.292592] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 1026.321285] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.321482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.321589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.321827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.321996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.333149] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 1026.418844] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: SUCCESS [ 1026.418844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.419092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.419255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.419536] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.419801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.419871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.420073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.420162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.420256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.420622] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.894686] env[69756]: INFO networking_nsxv3.common.synchronization [req-2c51751d-ca2d-4e2a-8760-4d5fbd9b8388 req-0eacfb6d-8650-4a12-8fba-162b493ca59d tempest-ServersTestManualDisk-175454458 tempest-ServersTestManualDisk-175454458-project-member] Enqueued Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_members [ 1026.895766] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGHEST for action security_group_members [ 1026.895766] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6688165-9289-4b4f-a688-1379d300b9cd taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.895766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.895766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.895766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.896149] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.896149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.896149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.896149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.896297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.896297] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.922281] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.178314] env[69756]: INFO networking_nsxv3.common.synchronization [req-cd2543a0-d123-47ce-826f-e2fd773dfe30 req-59b8cb18-3b24-475d-bea1-4828b98a22a9 tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1027.178671] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1027.179722] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.179899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.179969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.180243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.180418] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.180524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.180580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.180769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.180856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.180956] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.399180] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.399180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.399180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.399180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.427933] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47f4cc8e-dc8b-42c2-a280-bec009884679: rpc.has_security_group_logging(os_id): False [ 1027.432716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.432954] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.433094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.433161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.433472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.433567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.433661] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6688165-9289-4b4f-a688-1379d300b9cd is going to be updated. [ 1027.463962] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.464209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.464314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.464599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.464704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.465073] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.465196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.465263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.465439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.465522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.465612] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 is going to be created. [ 1027.504267] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.504418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.504488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.504710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.504857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.521201] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6688165-9289-4b4f-a688-1379d300b9cd in Status: IN_PROGRESS for 2s [ 1027.585402] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.585563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.585634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.585903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.586078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.610259] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: IN_PROGRESS for 2s [ 1027.683498] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.683708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.683773] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.684068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.684199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.684450] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.684601] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.684674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.684880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.684967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.685040] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc already deleted. [ 1027.685140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.745187] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.745509] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.745630] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.746205] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.746573] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.746903] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.747102] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.747506] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.747726] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.748112] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.748242] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.748394] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.748569] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.748775] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.748906] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.749641] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.775335] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.775512] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.775652] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.775867] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.776274] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-b733cece-2899-4d3e-9d48-835e7b9b28b7 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.776483] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-b733cece-2899-4d3e-9d48-835e7b9b28b7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.776629] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-b733cece-2899-4d3e-9d48-835e7b9b28b7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.777105] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-b733cece-2899-4d3e-9d48-835e7b9b28b7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.777428] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b733cece-2899-4d3e-9d48-835e7b9b28b7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.280497] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.280819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.280819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.281253] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.281253] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.281427] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port b733cece-2899-4d3e-9d48-835e7b9b28b7 not found, creating... [ 1028.281537] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.281699] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.281819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.282062] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.282318] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.282489] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.282648] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.282767] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.282977] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.286290] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.286471] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: b733cece-2899-4d3e-9d48-835e7b9b28b7 is going to be created. [ 1028.310101] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.310101] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.310101] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.310101] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.310101] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.310101] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-b733cece-2899-4d3e-9d48-835e7b9b28b7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.346528] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 1028.346765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.346900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.347136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.347710] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.347710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.347710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.347710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.347710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.348175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.348175] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.348175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.348175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.348413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.348588] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.348691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.348859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.349037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.349037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.349115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.349204] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.852364] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d34ec2a1-9b82-4a22-adf9-c9f049d563f8: rpc.has_security_group_logging(os_id): False [ 1028.873179] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.873383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.873383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.873674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.898993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.899286] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.899917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.899917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.899917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.899917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.900134] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.900134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.900219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.901146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.901146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.901146] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.901146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.901146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.901146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.901146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.901613] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 1029.004236] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.004236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.004236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.004236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.004236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.023160] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 1029.233439] env[69756]: INFO networking_nsxv3.common.synchronization [req-cd2543a0-d123-47ce-826f-e2fd773dfe30 req-ade6af34-0f04-4750-b686-4bdba938d2ef service nova] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 1029.233439] env[69756]: INFO networking_nsxv3.common.synchronization [req-cd2543a0-d123-47ce-826f-e2fd773dfe30 req-ade6af34-0f04-4750-b686-4bdba938d2ef service nova] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1029.233439] env[69756]: INFO networking_nsxv3.common.synchronization [req-cd2543a0-d123-47ce-826f-e2fd773dfe30 req-ade6af34-0f04-4750-b686-4bdba938d2ef service nova] Enqueued Resource ID: b733cece-2899-4d3e-9d48-835e7b9b28b7 with Priority: HIGHEST for action port [ 1029.233932] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 1029.233932] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1029.234069] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b733cece-2899-4d3e-9d48-835e7b9b28b7 with Priority: HIGHEST for action port [ 1029.238533] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.238666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.238733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.238938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.239038] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.240778] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.240778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.240778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.240778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.240778] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.240778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.240778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.241124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.241124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.241124] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.244760] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b733cece-2899-4d3e-9d48-835e7b9b28b7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.244760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b733cece-2899-4d3e-9d48-835e7b9b28b7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.244760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b733cece-2899-4d3e-9d48-835e7b9b28b7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.244760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b733cece-2899-4d3e-9d48-835e7b9b28b7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.245145] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b733cece-2899-4d3e-9d48-835e7b9b28b7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.532057] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6688165-9289-4b4f-a688-1379d300b9cd in Status: SUCCESS [ 1029.532057] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6688165-9289-4b4f-a688-1379d300b9cd deletion is rescheduled due to dependency. [ 1029.532441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.625426] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: SUCCESS [ 1029.625899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.747178] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.747313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.747840] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.748659] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b733cece-2899-4d3e-9d48-835e7b9b28b7 with status ACTIVE [ 1029.748892] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.749116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.749116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.749643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.749643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.750502] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.750502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.750502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.750502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.750502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.750502] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.750502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.750924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.750924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.750924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.750924] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b733cece-2899-4d3e-9d48-835e7b9b28b7 is going to be updated. [ 1029.783302] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.783470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.783561] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.783825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.784026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.784220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b733cece-2899-4d3e-9d48-835e7b9b28b7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.253570] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.294435] env[69756]: INFO networking_nsxv3.common.synchronization [req-f17faffe-a1f2-4630-80c5-8cbceed95e3a req-87d54fe3-2c4c-42e4-9a99-eaa43ee21786 tempest-MultipleCreateTestJSON-821679604 tempest-MultipleCreateTestJSON-821679604-project-member] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1030.300018] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1030.300018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.300018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.300018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.300018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.300018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.300018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.300018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.300018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.300018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.300018] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.593582] env[69756]: INFO networking_nsxv3.common.synchronization [req-d660536b-d06d-4dfc-a9d3-82b95041c0c2 req-193d2bde-1a33-4c7f-8f34-dc6902f93aad tempest-MultipleCreateTestJSON-821679604 tempest-MultipleCreateTestJSON-821679604-project-member] Enqueued Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1030.594180] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 with Priority: HIGHEST for action security_group_members [ 1030.594511] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.594615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.757546] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.757546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.757546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.757546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.757546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.758171] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be created. [ 1030.783309] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.783418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.783769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.784091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.784305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.794260] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: UNINITIALIZED for 2s [ 1030.800738] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.036559] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 1031.036792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.036972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.037215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.037407] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.303380] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.560836] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.560984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.561134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.561396] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.561504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.561635] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be deleted. [ 1031.625291] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.625873] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.625873] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.625999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.626116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.626253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.626443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.626638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.626737] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.806480] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.806727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.806727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.806963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.807056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.807153] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be updated. [ 1031.838695] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.838862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.838941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.839212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.839333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.849384] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: IN_PROGRESS for 2s [ 1032.146891] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.147050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.147123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.147430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.147528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.147628] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 already deleted. [ 1032.147712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.806670] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1032.807535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.807535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.807813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.808401] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.808401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.808401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.808578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.808578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.808647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.808735] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.821574] env[69756]: INFO networking_nsxv3.common.synchronization [req-70614bfd-86f7-4799-9fa1-09b1b2296704 req-da655947-0055-44b6-a231-45784346ec3e tempest-ServersTestBootFromVolume-553600348 tempest-ServersTestBootFromVolume-553600348-project-member] Enqueued Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_members [ 1032.822297] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGHEST for action security_group_members [ 1032.822455] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa5dd68d-835d-4416-ac9f-cab1591b2b82 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.822572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.822638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.822854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.822998] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.824230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.824306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.824505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.824651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.824806] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.910719] env[69756]: INFO networking_nsxv3.common.synchronization [req-3964f42d-3b52-40c8-a8d8-5ed5ac8c647f req-458ea3c6-9421-4e03-8834-027dcbf119bb tempest-ServerActionsV293TestJSON-543463791 tempest-ServerActionsV293TestJSON-543463791-project-member] Enqueued Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_members [ 1032.911997] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGHEST for action security_group_members [ 1032.911997] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.911997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.911997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.913741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.913933] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.914227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.914322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.914524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.914618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.914721] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.314101] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.327695] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.327888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.328841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.328841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.354976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.354976] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.354976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.354976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.354976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.354976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.354976] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 is going to be updated. [ 1033.386408] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.386630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.386851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.386987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.387188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.398707] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 in Status: IN_PROGRESS for 2s [ 1033.421135] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.421135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.421135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.421135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.421135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.421135] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.421135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.421135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.421135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.421135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.421135] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 is going to be updated. [ 1033.455131] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.455131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.455131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.455131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.455131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.465534] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 in Status: IN_PROGRESS for 2s [ 1033.816500] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc: rpc.has_security_group_logging(os_id): False [ 1033.842547] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.842793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.842877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.843740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.843740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.843740] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.843740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.843740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.843995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.848147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.848301] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be created. [ 1033.864597] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 in Status: SUCCESS [ 1033.864597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.864597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.864597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.864597] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.864597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.864597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.864597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.864597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.865108] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34ec2a1-9b82-4a22-adf9-c9f049d563f8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.915669] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.915868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.915868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.916046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.916224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.932081] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1034.369920] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.371212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.371327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.371618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.371755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.372265] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.375083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.375163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.375390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.375464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.375574] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34ec2a1-9b82-4a22-adf9-c9f049d563f8 is going to be deleted. [ 1034.411027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.411027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.411027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.411027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.411027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.411027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34ec2a1-9b82-4a22-adf9-c9f049d563f8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.609534] env[69756]: INFO networking_nsxv3.common.synchronization [req-a24e495f-b66b-4eed-96f0-128701be9b52 req-0ac4fdfc-a307-46c7-ada3-f8d773b449da tempest-ServersAdminTestJSON-2109728624 tempest-ServersAdminTestJSON-2109728624-project-member] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 1034.609798] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 1034.610288] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.610444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.610514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.612099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.612099] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.612776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.612879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.613143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.613250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.614041] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.115542] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.409511] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 in Status: SUCCESS [ 1035.409709] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 deletion is rescheduled due to dependency. [ 1035.409829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.479791] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 in Status: SUCCESS [ 1035.479791] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 deletion is rescheduled due to dependency. [ 1035.479791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.617930] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.949144] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1035.950161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.122104] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.122383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.122383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.123075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.123487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.123997] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 1036.159048] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.159048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.159048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.159048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.159048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.167089] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 1038.185217] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 1038.185217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.278508] env[69756]: INFO networking_nsxv3.common.synchronization [req-bc1eb4ab-cf37-4a7a-8749-b7a7e2bff431 req-323aa7fa-42dc-4296-8f7b-eca0a122a046 tempest-ServersAdminNegativeTestJSON-1545143736 tempest-ServersAdminNegativeTestJSON-1545143736-project-member] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 1038.279124] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGHEST for action security_group_members [ 1038.279367] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.279488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.279568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.279771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.279921] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.280030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.280088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.280472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.280472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.280472] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.784041] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.784041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.784041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.784041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.784041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.784041] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.784041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.784041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.784041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.784041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.784041] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf is going to be updated. [ 1038.825888] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.826046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.826080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.827807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.829087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.841497] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: IN_PROGRESS for 2s [ 1040.855758] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf in Status: SUCCESS [ 1040.856026] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf deletion is rescheduled due to dependency. [ 1040.857148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.115373] env[69756]: INFO networking_nsxv3.common.synchronization [req-24cdeaf1-8563-4004-ae59-4f7951e89867 req-c5853b94-3f78-429f-bcdc-d2ad48915a0f tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1041.116880] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1041.117432] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.117687] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.118569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.120499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.120499] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.120499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.120499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.120499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.120499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.120499] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.626865] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.626865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.626865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.626865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.626865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.626865] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.626865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.626865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.626865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.626865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.626865] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be deleted. [ 1041.657334] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.658705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.658705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.658705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.658705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.658705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.745137] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.746563] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.746563] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.746828] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.747127] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.747409] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.747409] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.747646] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.747806] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.748011] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.751543] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.751543] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.751543] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.751543] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.751543] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.751543] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.771638] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.773375] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.773375] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.773582] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.774051] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-3fa2e088-850d-45a4-9c19-a9819bad61dc taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.774305] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-3fa2e088-850d-45a4-9c19-a9819bad61dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.775134] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-3fa2e088-850d-45a4-9c19-a9819bad61dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.775507] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-3fa2e088-850d-45a4-9c19-a9819bad61dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.775721] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fa2e088-850d-45a4-9c19-a9819bad61dc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.282293] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.282630] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.282662] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.282946] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.283119] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.283280] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 3fa2e088-850d-45a4-9c19-a9819bad61dc not found, creating... [ 1042.283557] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.283723] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.283848] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.284089] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.284827] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.284827] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.284827] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.284827] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.285173] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.285562] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.285870] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 3fa2e088-850d-45a4-9c19-a9819bad61dc is going to be created. [ 1042.306095] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.306310] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.306439] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.306732] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.306959] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.307199] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-3fa2e088-850d-45a4-9c19-a9819bad61dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.359501] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b6e059c3-e04a-4944-8d1b-5b2e132cbaee None None] Enqueued Resource ID: 51ae898b-c936-4a4b-ac2d-30d39242d6cf with Priority: HIGHEST for action port [ 1042.359501] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51ae898b-c936-4a4b-ac2d-30d39242d6cf with Priority: HIGHEST for action port [ 1042.359501] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-51ae898b-c936-4a4b-ac2d-30d39242d6cf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.359501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51ae898b-c936-4a4b-ac2d-30d39242d6cf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.359501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51ae898b-c936-4a4b-ac2d-30d39242d6cf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.359501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51ae898b-c936-4a4b-ac2d-30d39242d6cf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.359501] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51ae898b-c936-4a4b-ac2d-30d39242d6cf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.867612] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51ae898b-c936-4a4b-ac2d-30d39242d6cf [ 1042.869920] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.869920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.869920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.869920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.869920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.869920] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51ae898b-c936-4a4b-ac2d-30d39242d6cf already deleted. [ 1042.869920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51ae898b-c936-4a4b-ac2d-30d39242d6cf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.153087] env[69756]: INFO networking_nsxv3.common.synchronization [req-24cdeaf1-8563-4004-ae59-4f7951e89867 req-64d0c2fe-189b-45c1-b559-57fb3693e485 service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 1043.153332] env[69756]: INFO networking_nsxv3.common.synchronization [req-24cdeaf1-8563-4004-ae59-4f7951e89867 req-64d0c2fe-189b-45c1-b559-57fb3693e485 service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1043.153478] env[69756]: INFO networking_nsxv3.common.synchronization [req-24cdeaf1-8563-4004-ae59-4f7951e89867 req-64d0c2fe-189b-45c1-b559-57fb3693e485 service nova] Enqueued Resource ID: 3fa2e088-850d-45a4-9c19-a9819bad61dc with Priority: HIGHEST for action port [ 1043.154041] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 1043.156962] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1043.157085] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa2e088-850d-45a4-9c19-a9819bad61dc with Priority: HIGHEST for action port [ 1043.158201] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.158337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.158409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.159242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.159242] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.165181] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.165181] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.165181] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.165181] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fa2e088-850d-45a4-9c19-a9819bad61dc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fa2e088-850d-45a4-9c19-a9819bad61dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fa2e088-850d-45a4-9c19-a9819bad61dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.165181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fa2e088-850d-45a4-9c19-a9819bad61dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.165181] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fa2e088-850d-45a4-9c19-a9819bad61dc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.482236] env[69756]: INFO networking_nsxv3.common.synchronization [None req-cc7b1444-e781-4e1b-ae6b-87dc454751e0 tempest-AttachVolumeTestJSON-1233597287 tempest-AttachVolumeTestJSON-1233597287-project-member] Enqueued Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_rules [ 1043.482668] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_rules [ 1043.483028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30452e03-76c9-417a-95b9-4a5e9c875fe6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.483516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.483623] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.483924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.484568] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.596427] env[69756]: INFO networking_nsxv3.common.synchronization [None req-20de5b9e-fcdf-4de9-b178-d7eff02cdf64 tempest-AttachVolumeTestJSON-1233597287 tempest-AttachVolumeTestJSON-1233597287-project-member] Enqueued Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_rules [ 1043.596911] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_rules [ 1043.598679] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30452e03-76c9-417a-95b9-4a5e9c875fe6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.598777] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.666070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.666070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.666277] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.667140] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fa2e088-850d-45a4-9c19-a9819bad61dc with status ACTIVE [ 1043.668626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.668626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.668626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.668626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.669348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.669348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.669348] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fa2e088-850d-45a4-9c19-a9819bad61dc is going to be updated. [ 1043.695781] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.696164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.696164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.696248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.696836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.696836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fa2e088-850d-45a4-9c19-a9819bad61dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.010499] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.012123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.012243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.012707] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.016019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.016019] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 already deleted. [ 1044.016019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.016019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.016019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.016019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.174693] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.535469] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.535754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.535754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.536567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.536567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.536567] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 already deleted. [ 1044.536567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.676233] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.676399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.676471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.676691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.676780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.676949] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be created. [ 1044.702033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.702229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.702285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.702495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.702664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.714296] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: UNINITIALIZED for 2s [ 1044.724533] env[69756]: INFO networking_nsxv3.common.synchronization [None req-91c60a0d-4ba2-469f-8838-a89d8825d31a None None] Enqueued Resource ID: c2fb5f60-ff9b-4676-aec0-e45e6d9b983d with Priority: HIGHEST for action port [ 1044.724822] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2fb5f60-ff9b-4676-aec0-e45e6d9b983d with Priority: HIGHEST for action port [ 1044.725391] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2fb5f60-ff9b-4676-aec0-e45e6d9b983d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.725512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2fb5f60-ff9b-4676-aec0-e45e6d9b983d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.725579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2fb5f60-ff9b-4676-aec0-e45e6d9b983d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.725847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2fb5f60-ff9b-4676-aec0-e45e6d9b983d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.725932] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2fb5f60-ff9b-4676-aec0-e45e6d9b983d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.228561] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2fb5f60-ff9b-4676-aec0-e45e6d9b983d [ 1045.228801] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.228940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.229016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.229235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.229327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.229445] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2fb5f60-ff9b-4676-aec0-e45e6d9b983d already deleted. [ 1045.229554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2fb5f60-ff9b-4676-aec0-e45e6d9b983d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.470166] env[69756]: INFO networking_nsxv3.common.synchronization [None req-94642ede-9087-4861-93f2-518b57557516 tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_rules [ 1046.470825] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_rules [ 1046.471205] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.471365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.471452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.472695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.472820] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.565646] env[69756]: INFO networking_nsxv3.common.synchronization [None req-dd183def-9386-4be3-a063-5ea0a2bf002e tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_rules [ 1046.566214] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_rules [ 1046.566510] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.566609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.725685] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1046.725866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.726044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.726262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.726453] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.726591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.726929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.726929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.726929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.727065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.727065] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.998727] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.998851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.998919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.999150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.999234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.999354] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 already deleted. [ 1046.999441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.000469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.000469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.000469] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.229380] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.229549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.229610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.229879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.230068] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.230174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.230234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.230391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.230472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.230558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.230698] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.230816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.230938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.230984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.231117] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.231203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.231260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.231393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.231463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.231539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.231620] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.522181] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.522449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.522449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.523304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.523304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.523304] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 already deleted. [ 1047.523304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.735510] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48c09f21-41e5-4def-8d66-8a36711be55a: rpc.has_security_group_logging(os_id): False [ 1047.753871] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.754028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.754099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.754310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.754392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.754602] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.754701] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.754763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.754907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.754977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.755157] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.755243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.755312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.755456] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.755617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.755688] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.755779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.755835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.755969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.757711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.757711] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be created. [ 1047.847658] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.847869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.847943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.848188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.848376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.865336] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1049.275074] env[69756]: INFO networking_nsxv3.common.synchronization [None req-67e6269e-2717-4248-b652-06fe0c49e570 tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_rules [ 1049.275493] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_rules [ 1049.276433] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.276608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.276682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.276996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.277076] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.446686] env[69756]: INFO networking_nsxv3.common.synchronization [None req-99004dcf-7438-47c2-8fce-3bf71dd32c26 tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_rules [ 1049.449225] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_rules [ 1049.450614] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.450786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.756201] env[69756]: INFO networking_nsxv3.common.synchronization [None req-d2061907-2b04-4f4d-89a1-419a3c9a9a2d None None] Enqueued Resource ID: 861d4aeb-0a4f-4705-a519-4e267b785200 with Priority: HIGHEST for action port [ 1049.756511] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 861d4aeb-0a4f-4705-a519-4e267b785200 with Priority: HIGHEST for action port [ 1049.760678] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-861d4aeb-0a4f-4705-a519-4e267b785200 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.760678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-861d4aeb-0a4f-4705-a519-4e267b785200" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.760678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-861d4aeb-0a4f-4705-a519-4e267b785200" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.760678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-861d4aeb-0a4f-4705-a519-4e267b785200" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.760678] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('861d4aeb-0a4f-4705-a519-4e267b785200',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.797350] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.797521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.797591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.797831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.797919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.798018] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 already deleted. [ 1049.798113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.798279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.798450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.798528] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.883506] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1049.883506] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.266022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 861d4aeb-0a4f-4705-a519-4e267b785200 [ 1050.266022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.266022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.266022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.266022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.266022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.266022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:861d4aeb-0a4f-4705-a519-4e267b785200 already deleted. [ 1050.266022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-861d4aeb-0a4f-4705-a519-4e267b785200" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.323152] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.323499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.323499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.323617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.323732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.323843] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 already deleted. [ 1050.323930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.302377] env[69756]: INFO networking_nsxv3.common.synchronization [req-85017bb9-49c6-4858-85f9-0798ca443fe5 req-7e6e1ab5-71c9-4ce4-9ccb-5dccb79ec4ec tempest-ServersTestFqdnHostnames-1788494129 tempest-ServersTestFqdnHostnames-1788494129-project-member] Enqueued Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_members [ 1051.302977] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGHEST for action security_group_members [ 1051.303306] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdf28d13-db76-40d0-a00d-750f9a74b1d7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.303430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.303499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.303699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.303857] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.303958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.304705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.304980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.304980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.305093] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.412587] env[69756]: INFO networking_nsxv3.common.synchronization [req-0c193a54-1675-4c4e-b388-d24412f16b72 req-ee9e7166-e2ad-4bee-96d0-84b83fb3bbdd tempest-ServersTestJSON-1985496736 tempest-ServersTestJSON-1985496736-project-member] Enqueued Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_members [ 1051.413107] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGHEST for action security_group_members [ 1051.413403] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-49317fc3-59c5-4b8b-a14b-79b0c266a17a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.414227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.414227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.414227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.414227] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.414454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.414525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.414684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.415073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.415073] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.532260] env[69756]: INFO networking_nsxv3.common.synchronization [req-f66c240a-9d33-4f6b-9dc0-256630d94e33 req-463ef592-9845-4115-94d8-c74567d8463a tempest-FloatingIPsAssociationTestJSON-1590966768 tempest-FloatingIPsAssociationTestJSON-1590966768-project-member] Enqueued Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1051.532538] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1051.532766] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.532890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.532956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.533841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.533931] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.534015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.534061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.534219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.534825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.534825] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.808580] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.808580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.808580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.808580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.828902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.831824] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.831983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.832164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.833619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.833619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.833619] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 is going to be updated. [ 1051.862368] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.862368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.862368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.862368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.862368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.872233] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 in Status: IN_PROGRESS for 2s [ 1051.919680] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.919680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.919680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.919680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.940111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.941189] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.941189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.941189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.941189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.941189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.941189] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a is going to be updated. [ 1051.967441] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.967441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.967441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.967686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.968465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.977687] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a in Status: IN_PROGRESS for 2s [ 1052.036369] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.115236] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.115236] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-805" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.115236] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-805" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.115236] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-805" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.118535] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.118922] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.118988] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.119315] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.119500] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.119774] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.120055] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.120055] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.120219] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.120387] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.120479] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.120640] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.141625] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.141798] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1052.141945] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.142332] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-805" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.142695] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-0e6280a5-8b7a-4e23-9376-7769c6896afb taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.142898] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-0e6280a5-8b7a-4e23-9376-7769c6896afb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.143044] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-0e6280a5-8b7a-4e23-9376-7769c6896afb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.143436] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-0e6280a5-8b7a-4e23-9376-7769c6896afb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.143610] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e6280a5-8b7a-4e23-9376-7769c6896afb',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.292293] env[69756]: INFO networking_nsxv3.common.synchronization [req-3cc02f1d-cd0a-4d0e-aff8-83c02280b3ae req-153cf419-6b1c-4dea-ba73-93b430e3e8f2 tempest-SecurityGroupRulesTestJSON-785098117 tempest-SecurityGroupRulesTestJSON-785098117-project-member] Enqueued Resource ID: edf87116-dcb9-485e-8908-20b68bee2aaa with Priority: HIGHEST for action security_group_rules [ 1052.292925] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edf87116-dcb9-485e-8908-20b68bee2aaa with Priority: HIGHEST for action security_group_rules [ 1052.293265] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edf87116-dcb9-485e-8908-20b68bee2aaa taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.293390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edf87116-dcb9-485e-8908-20b68bee2aaa" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.293458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edf87116-dcb9-485e-8908-20b68bee2aaa" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.293734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edf87116-dcb9-485e-8908-20b68bee2aaa" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.293815] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edf87116-dcb9-485e-8908-20b68bee2aaa',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.539416] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.641618] env[69756]: INFO networking_nsxv3.common.synchronization [None req-2737bfad-6d4f-4f27-ae6d-5dbeb77dae36 None None] Enqueued Resource ID: cb5e9ab2-c609-46a4-a473-ba865939e816 with Priority: HIGHEST for action port [ 1052.642653] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb5e9ab2-c609-46a4-a473-ba865939e816 with Priority: HIGHEST for action port [ 1052.643251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb5e9ab2-c609-46a4-a473-ba865939e816 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.643406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb5e9ab2-c609-46a4-a473-ba865939e816" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.643570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb5e9ab2-c609-46a4-a473-ba865939e816" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.643724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb5e9ab2-c609-46a4-a473-ba865939e816" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.643808] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb5e9ab2-c609-46a4-a473-ba865939e816',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.645492] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.645674] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.645897] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.646337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.646497] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.646958] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 0e6280a5-8b7a-4e23-9376-7769c6896afb not found, creating... [ 1052.647252] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.647524] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.647861] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.648130] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.648288] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.648783] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.648983] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.649125] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.649576] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.649742] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.649924] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 0e6280a5-8b7a-4e23-9376-7769c6896afb is going to be created. [ 1052.671429] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.671670] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.671859] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.672220] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.672477] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.672775] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-0e6280a5-8b7a-4e23-9376-7769c6896afb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.824293] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.824293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.824293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.824293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.824293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.824293] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edf87116-dcb9-485e-8908-20b68bee2aaa already deleted. [ 1052.824293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edf87116-dcb9-485e-8908-20b68bee2aaa" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.853304] env[69756]: INFO networking_nsxv3.common.synchronization [req-5b6218c1-b207-4e4e-b83c-d32b68e7cc98 req-233e1ed0-ce9f-4119-a724-5f1a533ff1b6 tempest-SecurityGroupRulesTestJSON-785098117 tempest-SecurityGroupRulesTestJSON-785098117-project-member] Enqueued Resource ID: 48c01778-7ece-4f05-951b-99fecc9fcf99 with Priority: HIGHEST for action security_group_rules [ 1052.853930] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c01778-7ece-4f05-951b-99fecc9fcf99 with Priority: HIGHEST for action security_group_rules [ 1052.854276] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c01778-7ece-4f05-951b-99fecc9fcf99 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.855364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c01778-7ece-4f05-951b-99fecc9fcf99" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.855520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c01778-7ece-4f05-951b-99fecc9fcf99" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.859159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c01778-7ece-4f05-951b-99fecc9fcf99" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.859291] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c01778-7ece-4f05-951b-99fecc9fcf99',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.919829] env[69756]: INFO networking_nsxv3.common.synchronization [None req-0a1dd1d2-f513-435d-a3df-4bf6dce0a51b None None] Enqueued Resource ID: 9db6d29c-36b3-40c1-9fd7-3b12656f9371 with Priority: HIGHEST for action port [ 1052.920355] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9db6d29c-36b3-40c1-9fd7-3b12656f9371 with Priority: HIGHEST for action port [ 1052.920905] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-9db6d29c-36b3-40c1-9fd7-3b12656f9371 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.921043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9db6d29c-36b3-40c1-9fd7-3b12656f9371" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.921115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9db6d29c-36b3-40c1-9fd7-3b12656f9371" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.921370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9db6d29c-36b3-40c1-9fd7-3b12656f9371" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.921457] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9db6d29c-36b3-40c1-9fd7-3b12656f9371',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.042519] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.042743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.042856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.043211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.043361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.043517] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e923000-de4f-4614-8d9f-829896824884 is going to be updated. [ 1053.076561] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.076878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.076878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.077252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.077485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.088890] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: IN_PROGRESS for 2s [ 1053.152375] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb5e9ab2-c609-46a4-a473-ba865939e816 [ 1053.152535] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.153374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.153374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.153374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.153374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.153551] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb5e9ab2-c609-46a4-a473-ba865939e816 already deleted. [ 1053.153551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb5e9ab2-c609-46a4-a473-ba865939e816" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.385101] env[69756]: INFO networking_nsxv3.common.synchronization [req-a4949c29-f735-43b7-a370-f4eb885836ad req-bd5c77b3-9dae-4a21-9d70-e751e67798ed tempest-SecurityGroupRulesTestJSON-785098117 tempest-SecurityGroupRulesTestJSON-785098117-project-member] Enqueued Resource ID: 61cf7b04-fc47-4456-892d-41c96293f74e with Priority: HIGHEST for action security_group_rules [ 1053.387557] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.387922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.388112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.388481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.389023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.389286] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c01778-7ece-4f05-951b-99fecc9fcf99 already deleted. [ 1053.390497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c01778-7ece-4f05-951b-99fecc9fcf99" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.391064] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61cf7b04-fc47-4456-892d-41c96293f74e with Priority: HIGHEST for action security_group_rules [ 1053.391838] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61cf7b04-fc47-4456-892d-41c96293f74e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.392156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61cf7b04-fc47-4456-892d-41c96293f74e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.392704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61cf7b04-fc47-4456-892d-41c96293f74e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.393352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61cf7b04-fc47-4456-892d-41c96293f74e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.393352] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61cf7b04-fc47-4456-892d-41c96293f74e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.424482] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9db6d29c-36b3-40c1-9fd7-3b12656f9371 [ 1053.424722] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.424860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.424930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.425181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.425274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.425369] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9db6d29c-36b3-40c1-9fd7-3b12656f9371 already deleted. [ 1053.425456] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9db6d29c-36b3-40c1-9fd7-3b12656f9371" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.499095] env[69756]: INFO networking_nsxv3.common.synchronization [req-f66c240a-9d33-4f6b-9dc0-256630d94e33 req-c167d118-4a71-4da5-90de-7e332d1b0cf0 service nova] Enqueued Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_rules [ 1053.501326] env[69756]: INFO networking_nsxv3.common.synchronization [req-f66c240a-9d33-4f6b-9dc0-256630d94e33 req-c167d118-4a71-4da5-90de-7e332d1b0cf0 service nova] Enqueued Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1053.501640] env[69756]: INFO networking_nsxv3.common.synchronization [req-f66c240a-9d33-4f6b-9dc0-256630d94e33 req-c167d118-4a71-4da5-90de-7e332d1b0cf0 service nova] Enqueued Resource ID: 0e6280a5-8b7a-4e23-9376-7769c6896afb with Priority: HIGHEST for action port [ 1053.502566] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_rules [ 1053.502721] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1053.502823] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e6280a5-8b7a-4e23-9376-7769c6896afb with Priority: HIGHEST for action port [ 1053.503148] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.503279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.503347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.503558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.503644] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.504682] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.504774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.504956] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e6280a5-8b7a-4e23-9376-7769c6896afb taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.505073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e6280a5-8b7a-4e23-9376-7769c6896afb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.505139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e6280a5-8b7a-4e23-9376-7769c6896afb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.505329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e6280a5-8b7a-4e23-9376-7769c6896afb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.505410] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e6280a5-8b7a-4e23-9376-7769c6896afb',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.886203] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 in Status: SUCCESS [ 1053.886519] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 deletion is rescheduled due to dependency. [ 1053.886519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.920076] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.920243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.920527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.920527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.920639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.920718] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61cf7b04-fc47-4456-892d-41c96293f74e already deleted. [ 1053.920965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61cf7b04-fc47-4456-892d-41c96293f74e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.991206] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a in Status: SUCCESS [ 1053.991887] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a deletion is rescheduled due to dependency. [ 1053.991887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.010506] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.010657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.010969] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e6280a5-8b7a-4e23-9376-7769c6896afb with status ACTIVE [ 1054.011479] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.011479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.011479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.011730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.011730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.011848] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.011951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.013130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.013130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.013130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.013130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.013130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.013130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.013130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.013130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.013130] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e6280a5-8b7a-4e23-9376-7769c6896afb is going to be updated. [ 1054.049362] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.049362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.049362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.049362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.049362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.049362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e6280a5-8b7a-4e23-9376-7769c6896afb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.514025] env[69756]: INFO networking_nsxv3.common.synchronization [req-69de965c-0dca-412f-a2e7-08ddde1f894a req-82fdb1b1-4a28-4ea7-b1e5-1550f4cc821d tempest-SecurityGroupRulesTestJSON-785098117 tempest-SecurityGroupRulesTestJSON-785098117-project-member] Enqueued Resource ID: d7a46dce-3ac6-41fe-9fc9-5681f098fb7d with Priority: HIGHEST for action security_group_rules [ 1054.514025] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a46dce-3ac6-41fe-9fc9-5681f098fb7d with Priority: HIGHEST for action security_group_rules [ 1054.514025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7a46dce-3ac6-41fe-9fc9-5681f098fb7d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.514025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7a46dce-3ac6-41fe-9fc9-5681f098fb7d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.514025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7a46dce-3ac6-41fe-9fc9-5681f098fb7d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.514025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7a46dce-3ac6-41fe-9fc9-5681f098fb7d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.514025] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7a46dce-3ac6-41fe-9fc9-5681f098fb7d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.003699] env[69756]: INFO networking_nsxv3.common.synchronization [req-2cc5e0a7-cf35-4236-a24f-b253cc4fe974 req-9ff7c84a-5feb-4d84-8218-9e814e9af9c3 tempest-SecurityGroupRulesTestJSON-785098117 tempest-SecurityGroupRulesTestJSON-785098117-project-member] Enqueued Resource ID: 34ed6f97-9702-4c6d-bb8d-f3e535e39263 with Priority: HIGHEST for action security_group_rules [ 1055.004291] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ed6f97-9702-4c6d-bb8d-f3e535e39263 with Priority: HIGHEST for action security_group_rules [ 1055.004601] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.004723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.004791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.005716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.005888] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34ed6f97-9702-4c6d-bb8d-f3e535e39263',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.033726] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.033726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.033726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.033905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.033954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.034068] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7a46dce-3ac6-41fe-9fc9-5681f098fb7d already deleted. [ 1055.034500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7a46dce-3ac6-41fe-9fc9-5681f098fb7d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.102995] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: SUCCESS [ 1055.103234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.103398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.103612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.103794] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.104077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.104077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.104182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.104216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.104362] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.201582] env[69756]: INFO networking_nsxv3.common.synchronization [req-f557fdb1-edda-4196-b349-e011cea0555d req-0f074603-cf1a-4dd5-8830-55672bc0c104 tempest-SecurityGroupRulesTestJSON-785098117 tempest-SecurityGroupRulesTestJSON-785098117-project-member] Enqueued Resource ID: 34ed6f97-9702-4c6d-bb8d-f3e535e39263 with Priority: HIGHEST for action security_group_rules [ 1055.202177] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ed6f97-9702-4c6d-bb8d-f3e535e39263 with Priority: HIGHEST for action security_group_rules [ 1055.202495] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.202605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.459284] env[69756]: INFO networking_nsxv3.common.synchronization [req-95f27e46-bb5e-4f0d-b548-4504a836cf7f req-6af09628-6acb-4b4b-8944-e7efda8788d8 tempest-SecurityGroupRulesTestJSON-785098117 tempest-SecurityGroupRulesTestJSON-785098117-project-member] Enqueued Resource ID: 34ed6f97-9702-4c6d-bb8d-f3e535e39263 with Priority: HIGHEST for action security_group_rules [ 1055.459284] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ed6f97-9702-4c6d-bb8d-f3e535e39263 with Priority: HIGHEST for action security_group_rules [ 1055.459284] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.460031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.531756] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.532206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.532317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.532549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.533207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.533207] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34ed6f97-9702-4c6d-bb8d-f3e535e39263 already deleted. [ 1055.533207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.533207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.533207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.533394] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34ed6f97-9702-4c6d-bb8d-f3e535e39263',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.600184] env[69756]: INFO networking_nsxv3.common.synchronization [None req-f0a80f0e-e078-4fa3-802a-cbb9664c87ac None None] Enqueued Resource ID: eddac282-e0a1-4f12-962f-5ccf7fcfe356 with Priority: HIGHEST for action port [ 1055.600503] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eddac282-e0a1-4f12-962f-5ccf7fcfe356 with Priority: HIGHEST for action port [ 1055.601068] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-eddac282-e0a1-4f12-962f-5ccf7fcfe356 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.601068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eddac282-e0a1-4f12-962f-5ccf7fcfe356" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.601068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eddac282-e0a1-4f12-962f-5ccf7fcfe356" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.601390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eddac282-e0a1-4f12-962f-5ccf7fcfe356" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.601492] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eddac282-e0a1-4f12-962f-5ccf7fcfe356',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.606295] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.058375] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.059765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.059765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.059765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.059765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.059765] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34ed6f97-9702-4c6d-bb8d-f3e535e39263 already deleted. [ 1056.059765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.059765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.059765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.059765] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34ed6f97-9702-4c6d-bb8d-f3e535e39263',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.103844] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eddac282-e0a1-4f12-962f-5ccf7fcfe356 [ 1056.104098] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.104233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.104304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.104760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.104863] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.104965] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eddac282-e0a1-4f12-962f-5ccf7fcfe356 already deleted. [ 1056.105100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eddac282-e0a1-4f12-962f-5ccf7fcfe356" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.108515] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.584661] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.584838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.584881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.585474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.585474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.585474] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34ed6f97-9702-4c6d-bb8d-f3e535e39263 already deleted. [ 1056.585474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34ed6f97-9702-4c6d-bb8d-f3e535e39263" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.611725] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.611984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.611984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.612596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.612596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.612596] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e923000-de4f-4614-8d9f-829896824884 is going to be updated. [ 1056.644472] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.644634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.644711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.644974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.645144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.656345] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: IN_PROGRESS for 2s [ 1058.669367] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: SUCCESS [ 1058.669643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.669844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.670111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.670408] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.670542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.670647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.670873] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.670955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.671086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.671188] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.173837] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.174571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.174571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.174571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.174825] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.174825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.174825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.175543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.175543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.175543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.175690] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.175739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.175767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.175911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.176089] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.176147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.176235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.176340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.176466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.176516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.176580] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.681240] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e923000-de4f-4614-8d9f-829896824884: rpc.has_security_group_logging(os_id): False [ 1059.702671] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.702862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.702921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.703167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.728025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.728025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.728025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.728025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.728793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.728793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.728793] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e923000-de4f-4614-8d9f-829896824884 is going to be updated. [ 1059.800023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.800023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.800023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.800023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.800023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.814183] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: IN_PROGRESS for 2s [ 1060.279751] env[69756]: INFO networking_nsxv3.common.synchronization [req-67127f89-6d9f-4e6f-bf0f-f9a2be6fbf13 req-2a1b71a5-8902-4419-8bb1-c7a1a08d0d28 tempest-ServerAddressesTestJSON-1616269229 tempest-ServerAddressesTestJSON-1616269229-project-member] Enqueued Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGHEST for action security_group_members [ 1060.281090] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGHEST for action security_group_members [ 1060.281090] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e24a162-f28e-4e20-8805-9798b600cdda taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.281090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.281090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.281090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.281350] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.281350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.281444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.281562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.281641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.281732] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e24a162-f28e-4e20-8805-9798b600cdda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.593243] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.593449] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-11" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.593653] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-11" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.593956] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-11" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.594233] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.594403] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.594525] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.594846] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.598817] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.598944] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.599056] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.599304] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.599384] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.599452] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.599550] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.599711] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.620026] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.620227] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1060.620365] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.620960] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-11" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.620960] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.621232] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.621232] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.621575] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.621739] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1861fb0-b9c6-4c9f-a2ba-0841ca405988',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.784365] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.784689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.784689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.784934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.785060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.785297] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.785423] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.785503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.785724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.785841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.785953] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e24a162-f28e-4e20-8805-9798b600cdda already deleted. [ 1060.786051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.123977] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.124248] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.124607] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.124759] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.124916] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.125087] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port a1861fb0-b9c6-4c9f-a2ba-0841ca405988 not found, creating... [ 1061.125364] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.125526] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.125646] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.125908] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.126107] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.126448] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.126636] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.126786] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.127344] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.127344] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.127474] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: a1861fb0-b9c6-4c9f-a2ba-0841ca405988 is going to be created. [ 1061.157368] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.157607] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.157732] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.157985] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.158227] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.158451] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.633063] env[69756]: INFO networking_nsxv3.common.synchronization [None req-6048002e-22a0-4745-847b-f898f7c832af None None] Enqueued Resource ID: 3067a815-6fc2-4c75-acca-e0bdc23fcc9a with Priority: HIGHEST for action port [ 1061.633063] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3067a815-6fc2-4c75-acca-e0bdc23fcc9a with Priority: HIGHEST for action port [ 1061.634180] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-3067a815-6fc2-4c75-acca-e0bdc23fcc9a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.634471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3067a815-6fc2-4c75-acca-e0bdc23fcc9a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.634629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3067a815-6fc2-4c75-acca-e0bdc23fcc9a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.634972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3067a815-6fc2-4c75-acca-e0bdc23fcc9a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.635177] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3067a815-6fc2-4c75-acca-e0bdc23fcc9a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.832374] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: SUCCESS [ 1061.833975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.137711] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3067a815-6fc2-4c75-acca-e0bdc23fcc9a [ 1062.137991] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.138161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.138229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.138452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.138536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.138628] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3067a815-6fc2-4c75-acca-e0bdc23fcc9a already deleted. [ 1062.138724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3067a815-6fc2-4c75-acca-e0bdc23fcc9a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.190787] env[69756]: INFO networking_nsxv3.common.synchronization [req-67127f89-6d9f-4e6f-bf0f-f9a2be6fbf13 req-63b634ba-f65c-4998-a3cf-a041f2a14856 service nova] Enqueued Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGHEST for action security_group_rules [ 1062.191172] env[69756]: INFO networking_nsxv3.common.synchronization [req-67127f89-6d9f-4e6f-bf0f-f9a2be6fbf13 req-63b634ba-f65c-4998-a3cf-a041f2a14856 service nova] Enqueued Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGHEST for action security_group_members [ 1062.191172] env[69756]: INFO networking_nsxv3.common.synchronization [req-67127f89-6d9f-4e6f-bf0f-f9a2be6fbf13 req-63b634ba-f65c-4998-a3cf-a041f2a14856 service nova] Enqueued Resource ID: a1861fb0-b9c6-4c9f-a2ba-0841ca405988 with Priority: HIGHEST for action port [ 1062.191780] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGHEST for action security_group_rules [ 1062.191917] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGHEST for action security_group_members [ 1062.192624] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1861fb0-b9c6-4c9f-a2ba-0841ca405988 with Priority: HIGHEST for action port [ 1062.192624] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e24a162-f28e-4e20-8805-9798b600cdda taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.192821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.192821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.193232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.193546] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e24a162-f28e-4e20-8805-9798b600cdda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.195330] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e24a162-f28e-4e20-8805-9798b600cdda taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.195330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.195330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.196329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.198215] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.198215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.198215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.198215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.198215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.198215] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e24a162-f28e-4e20-8805-9798b600cdda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.199000] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.199167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.199236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.199505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.199505] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1861fb0-b9c6-4c9f-a2ba-0841ca405988',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.703338] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1861fb0-b9c6-4c9f-a2ba-0841ca405988 with status ACTIVE [ 1062.703338] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.703338] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.703338] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.703338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.703338] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1861fb0-b9c6-4c9f-a2ba-0841ca405988 is going to be updated. [ 1062.708354] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e24a162-f28e-4e20-8805-9798b600cdda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.709365] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e24a162-f28e-4e20-8805-9798b600cdda taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.709475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.745541] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.745776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.745776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.745873] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.745993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.746220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1861fb0-b9c6-4c9f-a2ba-0841ca405988" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.974194] env[69756]: INFO networking_nsxv3.common.synchronization [req-e3b677e7-008d-47ae-953e-62fb796e1b5d req-5013299e-a6b0-4982-8c06-c5037f8ca3e0 tempest-ImagesOneServerNegativeTestJSON-724061913 tempest-ImagesOneServerNegativeTestJSON-724061913-project-member] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 1062.974530] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 1062.974823] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.974954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.974954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.976043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.976879] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.976879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.976879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.976879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.976879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.976879] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.211412] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e24a162-f28e-4e20-8805-9798b600cdda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.323375] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b4120254-25c5-4715-9b29-76f15604bdc0 tempest-ServersV294TestFqdnHostnames-406915398 tempest-ServersV294TestFqdnHostnames-406915398-project-member] Enqueued Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_rules [ 1063.323375] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_rules [ 1063.324103] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7abf7f6-a856-4157-be54-ef99b007674f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.324430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.324602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.324940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.325129] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.408496] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b4c5b704-1b10-4869-a907-98dccad56b17 tempest-ServersV294TestFqdnHostnames-406915398 tempest-ServersV294TestFqdnHostnames-406915398-project-member] Enqueued Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_rules [ 1063.408959] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_rules [ 1063.409108] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7abf7f6-a856-4157-be54-ef99b007674f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.409249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.479280] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.479434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.479509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.480444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.503688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.504017] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.504326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.504326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.505019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.505167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.505293] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be updated. [ 1063.539381] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.539884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.540072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.540341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.540529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.550814] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 1063.713952] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.714171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.714288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.714535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.714668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.714815] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e24a162-f28e-4e20-8805-9798b600cdda is going to be created. [ 1063.741174] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.741413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.741413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.741716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.741749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.751766] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e24a162-f28e-4e20-8805-9798b600cdda in Status: UNINITIALIZED for 2s [ 1063.852127] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.852350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.852669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.852669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.852788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.852908] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7abf7f6-a856-4157-be54-ef99b007674f already deleted. [ 1063.852908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.853105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.853298] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.853386] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.900986] env[69756]: INFO networking_nsxv3.common.synchronization [None req-12404c98-c6cb-4d1a-b4c9-47c1b26f001a None None] Enqueued Resource ID: bd464a31-3e33-4961-84c6-83a099a8faf2 with Priority: HIGHEST for action port [ 1063.901732] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd464a31-3e33-4961-84c6-83a099a8faf2 with Priority: HIGHEST for action port [ 1063.902215] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd464a31-3e33-4961-84c6-83a099a8faf2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.902384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd464a31-3e33-4961-84c6-83a099a8faf2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.902461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd464a31-3e33-4961-84c6-83a099a8faf2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.902734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd464a31-3e33-4961-84c6-83a099a8faf2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.902834] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd464a31-3e33-4961-84c6-83a099a8faf2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.977950] env[69756]: INFO networking_nsxv3.common.synchronization [req-20e46706-9c8d-4a50-b1c3-b9f56c6a221a req-b044b290-f66f-4d17-bbf4-7930cd5a2d50 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1063.980252] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1063.980696] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.980696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.980856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.981045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.981251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.981370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.981443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.981577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.981657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.981753] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.093814] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.094218] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.094351] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.094947] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.094947] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.095176] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.095306] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.095816] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.095816] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.096276] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.096276] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.096829] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.096829] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.096954] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.097104] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.097576] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.118258] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.118453] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.118600] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.118779] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-497" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.119120] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-682fcf25-d702-4758-a737-7cdf1fe4fb62 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.119703] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-682fcf25-d702-4758-a737-7cdf1fe4fb62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.119703] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-682fcf25-d702-4758-a737-7cdf1fe4fb62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.119819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-682fcf25-d702-4758-a737-7cdf1fe4fb62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.119933] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('682fcf25-d702-4758-a737-7cdf1fe4fb62',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.376346] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.376346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.376346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.376346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.376618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.376618] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7abf7f6-a856-4157-be54-ef99b007674f already deleted. [ 1064.376683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.391408] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.392093] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.392093] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.392093] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.392324] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.392811] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.392902] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.393151] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.394043] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.394043] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.394043] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.394043] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.394043] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.394043] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.394313] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.394313] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.404882] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd464a31-3e33-4961-84c6-83a099a8faf2 [ 1064.405155] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.405320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.405401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.405639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.405751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.405847] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd464a31-3e33-4961-84c6-83a099a8faf2 already deleted. [ 1064.405941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd464a31-3e33-4961-84c6-83a099a8faf2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.414622] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.414864] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.414970] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.415322] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.415721] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-618f384a-07f2-402f-8ed8-45f73a82f3e9 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.415893] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-618f384a-07f2-402f-8ed8-45f73a82f3e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.416032] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-618f384a-07f2-402f-8ed8-45f73a82f3e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.416405] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-618f384a-07f2-402f-8ed8-45f73a82f3e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.416560] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('618f384a-07f2-402f-8ed8-45f73a82f3e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.484237] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.484607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.484607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.484734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.484786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.484951] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.485054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.485115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.485258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.485327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.485416] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 already deleted. [ 1064.485515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.624214] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.624214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.624214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.624486] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.624486] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.624657] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 682fcf25-d702-4758-a737-7cdf1fe4fb62 not found, creating... [ 1064.624982] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.625166] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.625378] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.625636] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.625823] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.626222] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.626408] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.626558] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.626847] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.627108] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.627310] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 682fcf25-d702-4758-a737-7cdf1fe4fb62 is going to be created. [ 1064.655737] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.655937] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.656056] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.656502] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.656853] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.657244] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-682fcf25-d702-4758-a737-7cdf1fe4fb62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.919092] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.919334] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.919490] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.919786] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.919941] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.920156] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 618f384a-07f2-402f-8ed8-45f73a82f3e9 not found, creating... [ 1064.920459] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.920634] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.920923] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.921038] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.921241] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.921579] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.921891] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.922033] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.922424] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.922490] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.922592] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 618f384a-07f2-402f-8ed8-45f73a82f3e9 is going to be created. [ 1064.944790] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.945065] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.945355] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.945495] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.945792] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.946108] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-618f384a-07f2-402f-8ed8-45f73a82f3e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.036023] env[69756]: INFO networking_nsxv3.common.synchronization [req-03b2f8b1-4bf6-426a-9e35-745c3badcbe2 req-5c774b1b-3779-4be3-932a-6aee49a09adb tempest-MigrationsAdminTest-188051455 tempest-MigrationsAdminTest-188051455-project-member] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 1065.036023] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 1065.036777] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.037110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.037317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.037638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.037909] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.038203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.038386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.038676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.038881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.039095] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.541174] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.561877] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 1065.562085] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 deletion is rescheduled due to dependency. [ 1065.562241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.762783] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e24a162-f28e-4e20-8805-9798b600cdda in Status: SUCCESS [ 1065.763016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.763226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.763459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.763676] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.763803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.763852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.764032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.764107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.764213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.764314] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e24a162-f28e-4e20-8805-9798b600cdda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.945846] env[69756]: INFO networking_nsxv3.common.synchronization [req-e3b677e7-008d-47ae-953e-62fb796e1b5d req-e56b993a-d317-4a11-b1a8-c72da3164b96 service nova] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_rules [ 1065.946261] env[69756]: INFO networking_nsxv3.common.synchronization [req-e3b677e7-008d-47ae-953e-62fb796e1b5d req-e56b993a-d317-4a11-b1a8-c72da3164b96 service nova] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 1065.946520] env[69756]: INFO networking_nsxv3.common.synchronization [req-e3b677e7-008d-47ae-953e-62fb796e1b5d req-e56b993a-d317-4a11-b1a8-c72da3164b96 service nova] Enqueued Resource ID: 682fcf25-d702-4758-a737-7cdf1fe4fb62 with Priority: HIGHEST for action port [ 1065.947460] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_rules [ 1065.948346] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 1065.948613] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 682fcf25-d702-4758-a737-7cdf1fe4fb62 with Priority: HIGHEST for action port [ 1065.949071] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.949280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.949412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.949742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.949851] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.950831] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.950977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.951095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.951329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.951538] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.951652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.951721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.951908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.952013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.952112] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.953495] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-682fcf25-d702-4758-a737-7cdf1fe4fb62 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.953495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-682fcf25-d702-4758-a737-7cdf1fe4fb62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.953698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-682fcf25-d702-4758-a737-7cdf1fe4fb62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.953826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-682fcf25-d702-4758-a737-7cdf1fe4fb62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.953977] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('682fcf25-d702-4758-a737-7cdf1fe4fb62',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.045019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.071302] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bde2543-b514-48e2-8089-7392a1f3825a req-5193d721-f0b4-40c6-958a-26491b992f50 tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1066.072075] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1066.072417] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.072545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.072695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.072819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.072975] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.073093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.073156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.073500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.073611] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.073722] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.249885] env[69756]: INFO networking_nsxv3.common.synchronization [req-20e46706-9c8d-4a50-b1c3-b9f56c6a221a req-f60a5d5b-3c7e-4053-be9d-17a192a71ce3 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1066.250484] env[69756]: INFO networking_nsxv3.common.synchronization [req-20e46706-9c8d-4a50-b1c3-b9f56c6a221a req-f60a5d5b-3c7e-4053-be9d-17a192a71ce3 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1066.250484] env[69756]: INFO networking_nsxv3.common.synchronization [req-20e46706-9c8d-4a50-b1c3-b9f56c6a221a req-f60a5d5b-3c7e-4053-be9d-17a192a71ce3 service nova] Enqueued Resource ID: 618f384a-07f2-402f-8ed8-45f73a82f3e9 with Priority: HIGHEST for action port [ 1066.250606] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1066.251825] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1066.251825] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 618f384a-07f2-402f-8ed8-45f73a82f3e9 with Priority: HIGHEST for action port [ 1066.251825] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.251825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.251825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.251825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.252132] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.253056] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.253187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.253245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.253422] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.253564] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.253655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.253714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.253851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.253930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.254031] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.254754] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-618f384a-07f2-402f-8ed8-45f73a82f3e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.254853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-618f384a-07f2-402f-8ed8-45f73a82f3e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.254918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-618f384a-07f2-402f-8ed8-45f73a82f3e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.255114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-618f384a-07f2-402f-8ed8-45f73a82f3e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.257133] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('618f384a-07f2-402f-8ed8-45f73a82f3e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.266332] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e24a162-f28e-4e20-8805-9798b600cdda taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.266471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.266539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.266745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.267273] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.267273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.267273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.267519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.267576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.267755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.267908] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e24a162-f28e-4e20-8805-9798b600cdda taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.268231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.268460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.268644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.270021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.270021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.270021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.270021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.270021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.270021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.270021] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e24a162-f28e-4e20-8805-9798b600cdda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.456375] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.457347] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.457462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.457806] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 682fcf25-d702-4758-a737-7cdf1fe4fb62 with status ACTIVE [ 1066.458011] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.458122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.458188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.458454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.458626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.458727] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.458790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.458897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.459017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.460253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.460521] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.460657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.460747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.460941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.461065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.461210] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 682fcf25-d702-4758-a737-7cdf1fe4fb62 is going to be updated. [ 1066.485062] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.485823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.485951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.486211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.486390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.486944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-682fcf25-d702-4758-a737-7cdf1fe4fb62" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.548258] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.548432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.548500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.548713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.548806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.548899] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9593-3500-4c12-99da-d35935a142b3 is going to be updated. [ 1066.575904] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.576335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.576427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.576689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.576782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.576986] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.577111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.577174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.577373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.577455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.577544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1066.599832] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.599987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.600229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.600539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.600936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.620684] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: IN_PROGRESS for 2s [ 1066.622200] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.622359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.622359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.622587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.622823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.625943] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.626160] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.626289] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.626551] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.626887] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.627134] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.627278] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.627504] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.627653] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.627857] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.628509] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.628650] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.628769] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.628895] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.629015] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.629161] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.632763] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1066.646807] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.646981] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1066.647143] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.647322] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.647631] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-eda1bda7-6f75-43b6-8c8b-64bec7f96666 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.647804] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-eda1bda7-6f75-43b6-8c8b-64bec7f96666" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.647939] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-eda1bda7-6f75-43b6-8c8b-64bec7f96666" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.648293] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-eda1bda7-6f75-43b6-8c8b-64bec7f96666" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.648451] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eda1bda7-6f75-43b6-8c8b-64bec7f96666',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.757413] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.757413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.757658] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.758613] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 618f384a-07f2-402f-8ed8-45f73a82f3e9 with status ACTIVE [ 1066.758706] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.758846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.758881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.759101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.759172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.759342] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.759507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.759507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.759650] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.759726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.759903] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.760066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.760104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.760249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.760322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.760410] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 618f384a-07f2-402f-8ed8-45f73a82f3e9 is going to be updated. [ 1066.772580] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e24a162-f28e-4e20-8805-9798b600cdda: rpc.has_security_group_logging(os_id): False [ 1066.785964] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.786621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.786621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.786780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.786960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.787176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-618f384a-07f2-402f-8ed8-45f73a82f3e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.792269] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.792500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.792500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.792657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.792713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.792948] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.793075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.793143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.793521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.793521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.793607] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.793668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.793785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.793926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.793993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.795157] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.795157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.795157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.795157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.795157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.795157] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e24a162-f28e-4e20-8805-9798b600cdda is going to be created. [ 1066.873672] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.873672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.873912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.873956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.874481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.891993] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e24a162-f28e-4e20-8805-9798b600cdda in Status: IN_PROGRESS for 2s [ 1066.959029] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.151016] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.151371] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.151424] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.151731] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.151917] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.154190] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port eda1bda7-6f75-43b6-8c8b-64bec7f96666 not found, creating... [ 1067.154603] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.154713] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.154850] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.155150] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.155307] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.155648] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.155833] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.155976] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.158278] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.158452] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.158627] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: eda1bda7-6f75-43b6-8c8b-64bec7f96666 is going to be created. [ 1067.194494] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.194735] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.194854] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.195210] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.195456] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.195687] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-eda1bda7-6f75-43b6-8c8b-64bec7f96666" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.262406] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.463816] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.463816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.463816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.463816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.463816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.463816] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be updated. [ 1067.492023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.493796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.494024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.494365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.494640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.504493] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 1067.767015] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.769582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.769582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.769582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.769582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.769582] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be created. [ 1067.799458] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.799458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.799458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.799458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.799458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.810310] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: UNINITIALIZED for 2s [ 1068.273400] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bde2543-b514-48e2-8089-7392a1f3825a req-2f93d814-43c7-40c1-960e-9153c0119887 service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 1068.273400] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bde2543-b514-48e2-8089-7392a1f3825a req-2f93d814-43c7-40c1-960e-9153c0119887 service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1068.273400] env[69756]: INFO networking_nsxv3.common.synchronization [req-2bde2543-b514-48e2-8089-7392a1f3825a req-2f93d814-43c7-40c1-960e-9153c0119887 service nova] Enqueued Resource ID: eda1bda7-6f75-43b6-8c8b-64bec7f96666 with Priority: HIGHEST for action port [ 1068.273400] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 1068.273400] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1068.273400] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda1bda7-6f75-43b6-8c8b-64bec7f96666 with Priority: HIGHEST for action port [ 1068.273400] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.273400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.273400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.273400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.273400] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.276741] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.276741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.276741] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-eda1bda7-6f75-43b6-8c8b-64bec7f96666 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.276741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eda1bda7-6f75-43b6-8c8b-64bec7f96666" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.276741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eda1bda7-6f75-43b6-8c8b-64bec7f96666" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.276741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eda1bda7-6f75-43b6-8c8b-64bec7f96666" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.276741] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eda1bda7-6f75-43b6-8c8b-64bec7f96666',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.633960] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: SUCCESS [ 1068.634103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.641978] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1068.642170] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 deletion is rescheduled due to dependency. [ 1068.642282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.642485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.642656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.642842] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.642957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.643028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.643182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.643262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.643521] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.778125] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.778275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.778490] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eda1bda7-6f75-43b6-8c8b-64bec7f96666 with status ACTIVE [ 1068.778662] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.778801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.778869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.779112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.779212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.779384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.779493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.779561] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.779758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.779854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.780164] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.780263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.780263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.780397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.780479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.780591] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eda1bda7-6f75-43b6-8c8b-64bec7f96666 is going to be updated. [ 1068.809228] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.809393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.810819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.810819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.810819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.810819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eda1bda7-6f75-43b6-8c8b-64bec7f96666" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.907111] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e24a162-f28e-4e20-8805-9798b600cdda in Status: SUCCESS [ 1068.907354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.146312] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.515752] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 1069.516164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.516292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.516742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.516988] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.517145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.517224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.517425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.517542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.517643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.517739] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.648471] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.825462] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1069.825816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.826553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.826889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.827204] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.827444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.827501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.827760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.827887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.828096] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.828189] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.020465] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.020773] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.021028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.021187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.021359] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.021479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.021479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.021621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.021683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.022376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.022376] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.022376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.022376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.022376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.022548] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.022548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.022620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.022724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.022772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.022850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.022947] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.152373] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.152628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.153603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.153603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.153603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.153603] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1070.189389] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.189578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.189617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.189829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.189983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.201023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1070.332194] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.332436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.332514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.332780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.333092] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.333210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.333210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.333613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.333613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.333777] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.333859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.333985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.334074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.334240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.334419] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.334549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.334641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.334793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.334876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.334953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.335141] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.527417] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8de5d68d-6838-4955-ae71-d9dd48c0a125: rpc.has_security_group_logging(os_id): False [ 1070.547270] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.547427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.547462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.547663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.547818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.547955] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.548155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.548207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.548332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.548413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.548608] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.548710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.548771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.548982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.548982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.551384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.551587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.551587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.551726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.551808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.551955] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be updated. [ 1070.639394] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.639658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.640409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.640409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.640409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.669014] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 1070.837973] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77ecb29c-d932-487b-b95d-59676b2a2f50: rpc.has_security_group_logging(os_id): False [ 1070.863022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.863022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.863022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.863022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.863528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.863528] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.863528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.863528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.863641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.863641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.863820] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be created. [ 1070.926301] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.927198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.927198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.927198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.927198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.940336] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1072.219440] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1072.219440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.219440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.219440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.219440] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.219440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.219440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.219440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.219440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.219440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.219440] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.683973] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 1072.684230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.722012] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.722311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.722311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.722918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.722918] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.722918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.723233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.723233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.723288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.723365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.723559] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.724629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.724629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.724629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.724629] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.724629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.724629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.724629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.724629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.725167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.725325] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.954195] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1072.954195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.229401] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8: rpc.has_security_group_logging(os_id): False [ 1073.250503] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.250503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.250503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.250503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.250503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.253378] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.253378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.253378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.253378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.254397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.258029] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.258029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.258029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.258029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.258029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.258029] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.258029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.258029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.258029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.258029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.258029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1073.275516] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1073.275516] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1073.356031] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.356031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.356031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.356031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.356031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.371581] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1075.388647] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1075.389045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.515787] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3fbf6b2-088c-45e3-b194-7edc3d6406c7 req-3548c2c7-0d28-4be9-b64e-1b1e644cfe7c tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1075.516362] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1075.516681] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.516805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.516872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.517176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.517326] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.517431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.517490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.517650] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.517747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.517844] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.658031] env[69756]: INFO networking_nsxv3.common.synchronization [req-16351362-c4c3-4b6f-8e97-b42aba28dacb req-fa8c9427-4702-4ff4-b713-37cb6ab4d92c tempest-ServersWithSpecificFlavorTestJSON-311311506 tempest-ServersWithSpecificFlavorTestJSON-311311506-project-member] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 1075.658031] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGHEST for action security_group_members [ 1075.658031] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.658031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.659769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.661796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.663071] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.663071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.663071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.663071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.663071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.663071] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.936525] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.936740] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.936905] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.937168] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.937468] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.937653] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.937795] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.938024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.939122] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.939122] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.939122] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.940454] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.940454] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.940454] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.940454] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.940454] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.959606] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.959782] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.959930] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.960136] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.960529] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-286a373d-c950-4730-84b1-0d314962f9c9 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.960684] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-286a373d-c950-4730-84b1-0d314962f9c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.960814] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-286a373d-c950-4730-84b1-0d314962f9c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.961213] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-286a373d-c950-4730-84b1-0d314962f9c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.961363] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('286a373d-c950-4730-84b1-0d314962f9c9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.022034] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.167745] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.167940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.168163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.168286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.168368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.168570] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.168694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.168783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.168957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.169063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.169154] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 is going to be updated. [ 1076.199258] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.199634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.199634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.199891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.199891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.210887] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: IN_PROGRESS for 2s [ 1076.464429] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.465638] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.465638] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.465638] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.465638] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.465638] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 286a373d-c950-4730-84b1-0d314962f9c9 not found, creating... [ 1076.465638] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.466585] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.466585] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.466585] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.466585] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.466772] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.466865] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.466917] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.467619] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.468248] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.468248] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 286a373d-c950-4730-84b1-0d314962f9c9 is going to be created. [ 1076.491038] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.491368] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.491673] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.491847] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.492088] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.493077] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-286a373d-c950-4730-84b1-0d314962f9c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.524202] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.914210] env[69756]: INFO networking_nsxv3.common.synchronization [req-20077e7a-e25d-443e-a234-6be585ea70b5 req-25f5af3e-74ef-409e-964c-d3d900a23e4c tempest-ServerAddressesTestJSON-1616269229 tempest-ServerAddressesTestJSON-1616269229-project-member] Enqueued Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGHEST for action security_group_members [ 1076.914210] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGHEST for action security_group_members [ 1076.914210] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e24a162-f28e-4e20-8805-9798b600cdda taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.914210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.914210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.914210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.914210] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.914518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.914518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.914518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.914605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.914634] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e24a162-f28e-4e20-8805-9798b600cdda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.026887] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.026887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.026887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.027117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.027117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.027704] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1077.034575] env[69756]: INFO networking_nsxv3.common.synchronization [req-35a8f5ca-84b0-41e7-9627-eb20485dea10 req-f0d64864-bd11-4aa5-afc9-6b2ded866402 tempest-FloatingIPsAssociationTestJSON-1590966768 tempest-FloatingIPsAssociationTestJSON-1590966768-project-member] Enqueued Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1077.035597] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1077.035597] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.035597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.035597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.035814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.035814] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.035972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.035972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.036704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.036704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.036704] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.064230] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.064403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.064457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.064664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.064809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.077044] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1077.418399] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.418399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.418399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.418399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.418399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.418399] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.418399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.418399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.418748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.418748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.418748] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e24a162-f28e-4e20-8805-9798b600cdda is going to be updated. [ 1077.456137] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.456137] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.456137] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.456137] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.456137] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.471022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e24a162-f28e-4e20-8805-9798b600cdda in Status: IN_PROGRESS for 2s [ 1077.532488] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3fbf6b2-088c-45e3-b194-7edc3d6406c7 req-02adc739-b75e-490c-9a1e-a108a0f88653 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 1077.532686] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3fbf6b2-088c-45e3-b194-7edc3d6406c7 req-02adc739-b75e-490c-9a1e-a108a0f88653 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1077.532830] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3fbf6b2-088c-45e3-b194-7edc3d6406c7 req-02adc739-b75e-490c-9a1e-a108a0f88653 service nova] Enqueued Resource ID: 286a373d-c950-4730-84b1-0d314962f9c9 with Priority: HIGHEST for action port [ 1077.533070] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 1077.533197] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1077.533293] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 286a373d-c950-4730-84b1-0d314962f9c9 with Priority: HIGHEST for action port [ 1077.533880] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.534010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.534202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.534417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.534503] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.535367] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.535469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.535947] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-286a373d-c950-4730-84b1-0d314962f9c9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.536069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-286a373d-c950-4730-84b1-0d314962f9c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.536135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-286a373d-c950-4730-84b1-0d314962f9c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.536316] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-286a373d-c950-4730-84b1-0d314962f9c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.536397] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('286a373d-c950-4730-84b1-0d314962f9c9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.539272] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.038594] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.038739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.038938] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 286a373d-c950-4730-84b1-0d314962f9c9 with status ACTIVE [ 1078.039125] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.039272] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.039304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.039499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.039590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.039760] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.043082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.043281] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.043547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.043640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.043872] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.043982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.044060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.044245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.044345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.044449] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 286a373d-c950-4730-84b1-0d314962f9c9 is going to be updated. [ 1078.049352] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.079436] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.079590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.079642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.079860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.079996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.080208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-286a373d-c950-4730-84b1-0d314962f9c9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.224948] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 in Status: SUCCESS [ 1078.224948] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 deletion is rescheduled due to dependency. [ 1078.224948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.452548] env[69756]: INFO networking_nsxv3.common.synchronization [req-92a4b87b-7eb3-47ed-a6f3-dd5aa6eaef0e req-2920e0ae-e771-4e09-a152-03982c68451a tempest-ImagesOneServerNegativeTestJSON-724061913 tempest-ImagesOneServerNegativeTestJSON-724061913-project-member] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 1078.454079] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGHEST for action security_group_members [ 1078.454816] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.455019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.455221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.455549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.455831] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.457547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.457547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.457547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.457547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.457547] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.552593] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.552952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.552952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.553064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.553148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.553247] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e923000-de4f-4614-8d9f-829896824884 is going to be updated. [ 1078.584541] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.587016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.587016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.587016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.587016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.594879] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: IN_PROGRESS for 2s [ 1078.959812] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.959977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.960071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.960332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.960431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.960638] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.960742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.960805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.960974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.961143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.961143] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be updated. [ 1078.997696] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.998061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.001115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.001115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.001115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.013325] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: IN_PROGRESS for 2s [ 1079.088505] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1079.088505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.088505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.088505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.088505] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.088505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.088505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.088505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.088505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.088505] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.439156] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e3c0749a-b813-468f-8325-458716d72909 None None] Enqueued Resource ID: 4c559a13-d342-4da5-98a6-a564f98d36f2 with Priority: HIGHEST for action port [ 1079.439505] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c559a13-d342-4da5-98a6-a564f98d36f2 with Priority: HIGHEST for action port [ 1079.439954] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c559a13-d342-4da5-98a6-a564f98d36f2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.440286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c559a13-d342-4da5-98a6-a564f98d36f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.441702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c559a13-d342-4da5-98a6-a564f98d36f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.441702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c559a13-d342-4da5-98a6-a564f98d36f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.441702] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c559a13-d342-4da5-98a6-a564f98d36f2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.481873] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e24a162-f28e-4e20-8805-9798b600cdda in Status: SUCCESS [ 1079.482679] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e24a162-f28e-4e20-8805-9798b600cdda deletion is rescheduled due to dependency. [ 1079.483989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.591765] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.944550] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c559a13-d342-4da5-98a6-a564f98d36f2 [ 1079.945014] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.945014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.945014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.947804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.947804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.947804] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c559a13-d342-4da5-98a6-a564f98d36f2 already deleted. [ 1079.947804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c559a13-d342-4da5-98a6-a564f98d36f2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.094295] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.597183] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.597494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.597494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.598317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.598443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.598569] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1080.608176] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: SUCCESS [ 1080.609633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.626923] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.626923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.626923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.626923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.627164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.636071] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1081.023221] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 in Status: SUCCESS [ 1081.023221] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 deletion is rescheduled due to dependency. [ 1081.023221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.802932] env[69756]: INFO networking_nsxv3.common.synchronization [None req-be719ffc-62b8-4853-9147-47e75b4fa646 None None] Enqueued Resource ID: fadc8c0b-a37b-4337-bafd-8481a2e7223b with Priority: HIGHEST for action port [ 1081.802932] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadc8c0b-a37b-4337-bafd-8481a2e7223b with Priority: HIGHEST for action port [ 1081.803645] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-fadc8c0b-a37b-4337-bafd-8481a2e7223b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.803757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fadc8c0b-a37b-4337-bafd-8481a2e7223b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.803789] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fadc8c0b-a37b-4337-bafd-8481a2e7223b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.809537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fadc8c0b-a37b-4337-bafd-8481a2e7223b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.809537] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fadc8c0b-a37b-4337-bafd-8481a2e7223b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.308758] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fadc8c0b-a37b-4337-bafd-8481a2e7223b [ 1082.309010] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.309454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.309454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.309566] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.309596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.309804] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fadc8c0b-a37b-4337-bafd-8481a2e7223b already deleted. [ 1082.309804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fadc8c0b-a37b-4337-bafd-8481a2e7223b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.575239] env[69756]: INFO networking_nsxv3.common.synchronization [req-87b6edee-ceac-4c60-9cdd-292b923925a1 req-a030b170-afd3-4376-baa0-72a38dc02d5b tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1082.575656] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1082.576763] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.577502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.577502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.577502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.577502] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.577502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.577502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.577843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.577843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.577843] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.651849] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1082.651849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.651849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.651849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.651849] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.651849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.651849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.651849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.651849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.651849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.651849] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.080922] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.080922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.080922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.081392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.081392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.081392] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.081501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.081501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.081663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.081734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.081826] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1083.126304] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.126304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.126304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.126531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.126852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.138151] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1083.153752] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.154119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.154598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.154910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.155206] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.155432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.155518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.155736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.155847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.155975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.156296] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.156429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.156429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.156570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.156744] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.156868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.156952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.157381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.157562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.157740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.157933] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.660492] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8feed-cd04-49d0-9fbe-c89808cf758f: rpc.has_security_group_logging(os_id): False [ 1083.680132] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.680132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.680132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.680132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.680132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.680341] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.680341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.680427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.680834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.680834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.680834] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.680983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.680983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.681135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.681206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.681402] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.681497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.681556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.681696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.681766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.681847] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1083.751122] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.751296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.751438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.751568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.751710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.766121] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1085.047260] env[69756]: INFO networking_nsxv3.common.synchronization [None req-21e0e4cc-8803-4623-85e5-72c3775de15f None None] Enqueued Resource ID: af74c6a3-fb31-4214-9306-135c4dd1a20f with Priority: HIGHEST for action port [ 1085.047526] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af74c6a3-fb31-4214-9306-135c4dd1a20f with Priority: HIGHEST for action port [ 1085.048516] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-af74c6a3-fb31-4214-9306-135c4dd1a20f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.048663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af74c6a3-fb31-4214-9306-135c4dd1a20f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.048735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af74c6a3-fb31-4214-9306-135c4dd1a20f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.048992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af74c6a3-fb31-4214-9306-135c4dd1a20f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.049203] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af74c6a3-fb31-4214-9306-135c4dd1a20f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.149742] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1085.149742] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 deletion is rescheduled due to dependency. [ 1085.149742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.554796] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af74c6a3-fb31-4214-9306-135c4dd1a20f [ 1085.554954] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.555079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.555145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.556063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.556184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.556289] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af74c6a3-fb31-4214-9306-135c4dd1a20f already deleted. [ 1085.556381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af74c6a3-fb31-4214-9306-135c4dd1a20f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.599022] env[69756]: INFO networking_nsxv3.common.synchronization [req-a6aed3ac-698d-4ee0-b0e1-7788d7e12347 req-dc5c64eb-a55c-455d-942e-c7ac90fd0739 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_members [ 1085.599022] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGHEST for action security_group_members [ 1085.599022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.599022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.599022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.599022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.599513] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.599747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.599909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.600183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.600364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.600552] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.783438] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1085.783438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.104199] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.106637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.106637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.106637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.106762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.106933] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.107054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.107118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.107273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.107349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.107437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17111ea1-decc-4289-b6f5-8ab312a62032 is going to be updated. [ 1086.139397] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.139616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.139616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.139828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.139998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.150292] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17111ea1-decc-4289-b6f5-8ab312a62032 in Status: IN_PROGRESS for 2s [ 1087.016794] env[69756]: INFO networking_nsxv3.common.synchronization [None req-474c969c-7efd-4b6b-bc9b-81f24e921fdb None None] Enqueued Resource ID: 87b2d09a-af6a-446a-b403-32daa787304f with Priority: HIGHEST for action port [ 1087.016995] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b2d09a-af6a-446a-b403-32daa787304f with Priority: HIGHEST for action port [ 1087.017630] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-87b2d09a-af6a-446a-b403-32daa787304f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.017704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87b2d09a-af6a-446a-b403-32daa787304f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.017777] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87b2d09a-af6a-446a-b403-32daa787304f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.018075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87b2d09a-af6a-446a-b403-32daa787304f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.018193] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87b2d09a-af6a-446a-b403-32daa787304f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.521779] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87b2d09a-af6a-446a-b403-32daa787304f [ 1087.521779] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.521779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.521779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.521779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.522268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.522268] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87b2d09a-af6a-446a-b403-32daa787304f already deleted. [ 1087.522268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87b2d09a-af6a-446a-b403-32daa787304f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.163023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17111ea1-decc-4289-b6f5-8ab312a62032 in Status: SUCCESS [ 1088.163023] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17111ea1-decc-4289-b6f5-8ab312a62032 deletion is rescheduled due to dependency. [ 1088.163023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.753038] env[69756]: INFO networking_nsxv3.common.synchronization [None req-399931ff-c986-4cf1-b56b-ae564d321985 None None] Enqueued Resource ID: fbfb6bd8-7960-459a-8b31-d9b8e175c1cc with Priority: HIGHEST for action port [ 1089.753038] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfb6bd8-7960-459a-8b31-d9b8e175c1cc with Priority: HIGHEST for action port [ 1089.753679] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbfb6bd8-7960-459a-8b31-d9b8e175c1cc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.753943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbfb6bd8-7960-459a-8b31-d9b8e175c1cc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.754104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbfb6bd8-7960-459a-8b31-d9b8e175c1cc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.754546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbfb6bd8-7960-459a-8b31-d9b8e175c1cc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.754716] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbfb6bd8-7960-459a-8b31-d9b8e175c1cc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.257863] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbfb6bd8-7960-459a-8b31-d9b8e175c1cc [ 1090.259030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.259030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.259030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.259030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.259030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.259030] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbfb6bd8-7960-459a-8b31-d9b8e175c1cc already deleted. [ 1090.259030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbfb6bd8-7960-459a-8b31-d9b8e175c1cc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.962575] env[69756]: INFO networking_nsxv3.common.synchronization [req-5dc75e88-1dd3-44b6-b1f0-0711b045cc77 req-c376d0fb-11d4-4542-8e20-9a8cda5ea71d tempest-ServersAdminTestJSON-2109728624 tempest-ServersAdminTestJSON-2109728624-project-member] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 1090.963168] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 1090.963480] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.963605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.964309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.964309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.964309] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.964309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.964309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.964582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.964582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.964582] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.471051] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.977600] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.207043] env[69756]: INFO networking_nsxv3.common.synchronization [None req-6cfc4040-4f2c-476b-b5ac-5927f4bf23d8 None None] Enqueued Resource ID: a0941dd9-c701-45d5-964d-ce91beb51183 with Priority: HIGHEST for action port [ 1092.207043] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0941dd9-c701-45d5-964d-ce91beb51183 with Priority: HIGHEST for action port [ 1092.207043] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0941dd9-c701-45d5-964d-ce91beb51183 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.207043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0941dd9-c701-45d5-964d-ce91beb51183" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.207043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0941dd9-c701-45d5-964d-ce91beb51183" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.207043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0941dd9-c701-45d5-964d-ce91beb51183" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.207043] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0941dd9-c701-45d5-964d-ce91beb51183',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.480507] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.480699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.480836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.480993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.481093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.481192] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 1092.522623] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.522769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.522838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.523139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.523336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.537030] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 1092.709551] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0941dd9-c701-45d5-964d-ce91beb51183 [ 1092.709852] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.709994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.710122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.710302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.710393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.710566] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0941dd9-c701-45d5-964d-ce91beb51183 already deleted. [ 1092.710691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0941dd9-c701-45d5-964d-ce91beb51183" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.729886] env[69756]: INFO networking_nsxv3.common.synchronization [None req-05707b53-2702-45a0-a2dc-ce97ea79ad86 None None] Enqueued Resource ID: e4534830-4ffe-476b-8784-b3e657f01146 with Priority: HIGHEST for action port [ 1093.729886] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4534830-4ffe-476b-8784-b3e657f01146 with Priority: HIGHEST for action port [ 1093.731186] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4534830-4ffe-476b-8784-b3e657f01146 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.731186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4534830-4ffe-476b-8784-b3e657f01146" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.731186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4534830-4ffe-476b-8784-b3e657f01146" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.731186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4534830-4ffe-476b-8784-b3e657f01146" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.731186] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4534830-4ffe-476b-8784-b3e657f01146',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.233321] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4534830-4ffe-476b-8784-b3e657f01146 [ 1094.234028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.234028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.234028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.234028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.234290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.234290] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4534830-4ffe-476b-8784-b3e657f01146 already deleted. [ 1094.234290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4534830-4ffe-476b-8784-b3e657f01146" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.548708] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 1094.549859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.286497] env[69756]: INFO networking_nsxv3.common.synchronization [None req-1c37ad90-f928-412b-8845-83a77200da6f None None] Enqueued Resource ID: 481e4d58-2e12-47fd-ba08-c1fa8a204b4c with Priority: HIGHEST for action port [ 1096.286790] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 481e4d58-2e12-47fd-ba08-c1fa8a204b4c with Priority: HIGHEST for action port [ 1096.287319] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-481e4d58-2e12-47fd-ba08-c1fa8a204b4c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.287436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-481e4d58-2e12-47fd-ba08-c1fa8a204b4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.287500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-481e4d58-2e12-47fd-ba08-c1fa8a204b4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.287749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-481e4d58-2e12-47fd-ba08-c1fa8a204b4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.287828] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('481e4d58-2e12-47fd-ba08-c1fa8a204b4c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.791104] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 481e4d58-2e12-47fd-ba08-c1fa8a204b4c [ 1096.791352] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.791486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.791672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.791934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.792105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.792143] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:481e4d58-2e12-47fd-ba08-c1fa8a204b4c already deleted. [ 1096.792215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-481e4d58-2e12-47fd-ba08-c1fa8a204b4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.712610] env[69756]: INFO networking_nsxv3.common.synchronization [req-0845ce04-ef06-4f1e-8c39-d4f2ceff79e0 req-e488c8f9-155f-41bf-a8de-d4180793ea3e tempest-AttachVolumeTestJSON-1233597287 tempest-AttachVolumeTestJSON-1233597287-project-member] Enqueued Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_members [ 1100.713164] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_members [ 1100.713491] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30452e03-76c9-417a-95b9-4a5e9c875fe6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.713634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.713706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.713950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.714466] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.714579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.714646] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.714807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.714894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.714989] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.088553] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.088828] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-801" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.088916] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-801" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.089229] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-801" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.089490] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.091449] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.091449] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.091449] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.091449] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.091449] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.091449] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.091449] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.091449] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.091449] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.091449] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.091449] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.112364] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.112535] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1101.112682] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.112864] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-801" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.113569] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-49f67be4-7d75-49f2-8f13-9c11445a8010 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.113569] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-49f67be4-7d75-49f2-8f13-9c11445a8010" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.113569] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-49f67be4-7d75-49f2-8f13-9c11445a8010" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.113845] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-49f67be4-7d75-49f2-8f13-9c11445a8010" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.113944] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49f67be4-7d75-49f2-8f13-9c11445a8010',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.217540] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.217841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.217923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.218158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.218158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.218452] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.218565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.218638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.218823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.218897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.218989] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 already deleted. [ 1101.219105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.616800] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.617052] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.617190] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.617861] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.618077] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.618249] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 49f67be4-7d75-49f2-8f13-9c11445a8010 not found, creating... [ 1101.618526] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.618757] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.618892] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.619157] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.619370] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.619596] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.619761] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.619902] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.620106] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.620250] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.620421] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 49f67be4-7d75-49f2-8f13-9c11445a8010 is going to be created. [ 1101.644697] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.644923] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.645067] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.645358] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.645967] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.645967] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-49f67be4-7d75-49f2-8f13-9c11445a8010" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.387485] env[69756]: INFO networking_nsxv3.common.synchronization [req-0845ce04-ef06-4f1e-8c39-d4f2ceff79e0 req-8130e049-7dbe-4242-a742-b25218ed451e service nova] Enqueued Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_rules [ 1102.387727] env[69756]: INFO networking_nsxv3.common.synchronization [req-0845ce04-ef06-4f1e-8c39-d4f2ceff79e0 req-8130e049-7dbe-4242-a742-b25218ed451e service nova] Enqueued Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_members [ 1102.387727] env[69756]: INFO networking_nsxv3.common.synchronization [req-0845ce04-ef06-4f1e-8c39-d4f2ceff79e0 req-8130e049-7dbe-4242-a742-b25218ed451e service nova] Enqueued Resource ID: 49f67be4-7d75-49f2-8f13-9c11445a8010 with Priority: HIGHEST for action port [ 1102.387934] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_rules [ 1102.388050] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_members [ 1102.388144] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f67be4-7d75-49f2-8f13-9c11445a8010 with Priority: HIGHEST for action port [ 1102.388805] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30452e03-76c9-417a-95b9-4a5e9c875fe6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.388895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.388961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.389818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.389944] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.391388] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30452e03-76c9-417a-95b9-4a5e9c875fe6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.391673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.391673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.391841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.391979] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.392092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.392156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.392742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.392742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.392866] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.393752] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-49f67be4-7d75-49f2-8f13-9c11445a8010 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.393863] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49f67be4-7d75-49f2-8f13-9c11445a8010" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.393926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49f67be4-7d75-49f2-8f13-9c11445a8010" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.394090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49f67be4-7d75-49f2-8f13-9c11445a8010" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.394171] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49f67be4-7d75-49f2-8f13-9c11445a8010',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.892052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30452e03-76c9-417a-95b9-4a5e9c875fe6 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.892282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.896612] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49f67be4-7d75-49f2-8f13-9c11445a8010 with status ACTIVE [ 1102.897646] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.897787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.897868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.898109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.898203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.898382] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.898480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.898538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.898716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.898805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.898986] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.899118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.899181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.899327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.899402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.899487] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49f67be4-7d75-49f2-8f13-9c11445a8010 is going to be updated. [ 1102.900809] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.925390] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.925592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.925592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.926395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.926395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.926395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49f67be4-7d75-49f2-8f13-9c11445a8010" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.304171] env[69756]: INFO networking_nsxv3.common.synchronization [req-4ddf96f2-30ef-4512-85f6-288496488203 req-ea9915f4-f659-47cc-9bb3-f6f91fe7d5a9 tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_members [ 1103.304171] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_members [ 1103.304171] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.304171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.304171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.304171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.304404] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.304404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.304479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.304729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.304859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.305009] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.403144] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.704489] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.704688] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.704818] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.705113] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.705368] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.705532] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.705651] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.705866] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.707323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.707987] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.708144] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.708266] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.708386] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.708508] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.708623] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.708761] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.729373] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.729464] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1103.729603] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.730193] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.730193] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.730426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.730426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.730957] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.730957] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04ce63af-5cc6-45ec-b5ec-5ad655519b1d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.809100] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.809100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.809100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.809100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.809100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.809100] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.809100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.809100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.809100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.809100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.809100] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 already deleted. [ 1103.809498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.906507] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.906673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.906749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.906969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.907070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.907184] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 is going to be created. [ 1103.931865] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.932043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.932225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.932302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.932527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.950565] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 in Status: UNINITIALIZED for 2s [ 1104.234099] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.234337] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.234528] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.235152] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.235394] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.235394] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 04ce63af-5cc6-45ec-b5ec-5ad655519b1d not found, creating... [ 1104.235842] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.236071] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.236286] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.236629] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.236818] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.237274] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.237553] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.237790] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.238058] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.238212] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.238365] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 04ce63af-5cc6-45ec-b5ec-5ad655519b1d is going to be created. [ 1104.260658] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.260658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.260658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.261056] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.261306] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.261542] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.017635] env[69756]: INFO networking_nsxv3.common.synchronization [req-4ddf96f2-30ef-4512-85f6-288496488203 req-e4c73b9f-794d-4597-84ec-3e21ac596394 service nova] Enqueued Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_rules [ 1105.017874] env[69756]: INFO networking_nsxv3.common.synchronization [req-4ddf96f2-30ef-4512-85f6-288496488203 req-e4c73b9f-794d-4597-84ec-3e21ac596394 service nova] Enqueued Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_members [ 1105.017940] env[69756]: INFO networking_nsxv3.common.synchronization [req-4ddf96f2-30ef-4512-85f6-288496488203 req-e4c73b9f-794d-4597-84ec-3e21ac596394 service nova] Enqueued Resource ID: 04ce63af-5cc6-45ec-b5ec-5ad655519b1d with Priority: HIGHEST for action port [ 1105.018176] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_rules [ 1105.018312] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_members [ 1105.018411] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ce63af-5cc6-45ec-b5ec-5ad655519b1d with Priority: HIGHEST for action port [ 1105.019455] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.019628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.019765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.019962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.020356] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.022215] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.022317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.024072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.024072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.024072] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.024072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.024072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.024072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.024072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.024072] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.024072] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.024658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.024658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.024658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.024751] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04ce63af-5cc6-45ec-b5ec-5ad655519b1d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.527482] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.528177] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.528311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.528654] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04ce63af-5cc6-45ec-b5ec-5ad655519b1d with status ACTIVE [ 1105.530651] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.530651] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.530651] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.530651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.530651] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04ce63af-5cc6-45ec-b5ec-5ad655519b1d is going to be updated. [ 1105.551305] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.551512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.551512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.551778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.551954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.552543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04ce63af-5cc6-45ec-b5ec-5ad655519b1d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.963094] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 in Status: SUCCESS [ 1105.963433] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.963536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.963731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.963926] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.964060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.964118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.964304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.964437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.964509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.964559] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.030061] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.290224] env[69756]: INFO networking_nsxv3.common.synchronization [req-78727252-56e8-47a4-ac4b-39018a14a3aa req-a51547d3-2ab0-4203-b868-71e0c46b7a8f tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_members [ 1106.290224] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_members [ 1106.290224] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.290224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.290224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.290224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.290952] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.290952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.291098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.291176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.291261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.291356] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.468617] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.532540] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.532694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.532781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.532983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.533100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.533205] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 is going to be created. [ 1106.558662] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.558875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.559509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.559509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.559509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.573315] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 in Status: UNINITIALIZED for 2s [ 1106.795137] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.795333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.795333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.795462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.795683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.795935] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.796054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.796119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.796388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.796388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.796469] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 already deleted. [ 1106.796533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.835683] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.835868] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.836597] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.836597] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.836597] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.836772] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.836804] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.837279] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.837607] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.837962] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.838123] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.838366] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.838599] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.839066] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.839409] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.839701] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.864020] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.864020] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1106.864020] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.864020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.864020] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-58ee1639-3131-42e9-a241-63b661e11ab4 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.864020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-58ee1639-3131-42e9-a241-63b661e11ab4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.864020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-58ee1639-3131-42e9-a241-63b661e11ab4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.864020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-58ee1639-3131-42e9-a241-63b661e11ab4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.864559] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58ee1639-3131-42e9-a241-63b661e11ab4',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.975149] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30452e03-76c9-417a-95b9-4a5e9c875fe6: rpc.has_security_group_logging(os_id): False [ 1106.992099] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.992294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.992341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.992522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.992613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.992849] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.992953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.993027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.993206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.993286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.993387] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 is going to be created. [ 1107.054343] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.054343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.054343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.054343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.054770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.065463] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 in Status: IN_PROGRESS for 2s [ 1107.373021] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.373021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.373021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.373021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.373021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.373021] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 58ee1639-3131-42e9-a241-63b661e11ab4 not found, creating... [ 1107.373021] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.373021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.373021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.373021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.373021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.373543] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.373543] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.373936] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.374440] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.374702] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.374987] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 58ee1639-3131-42e9-a241-63b661e11ab4 is going to be created. [ 1107.402886] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.402886] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.402886] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.402886] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.402886] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.402886] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-58ee1639-3131-42e9-a241-63b661e11ab4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.454282] env[69756]: INFO networking_nsxv3.common.synchronization [req-78727252-56e8-47a4-ac4b-39018a14a3aa req-7776bb98-c5be-46ae-bc7e-cc4e42c8e0f5 service nova] Enqueued Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_rules [ 1108.454554] env[69756]: INFO networking_nsxv3.common.synchronization [req-78727252-56e8-47a4-ac4b-39018a14a3aa req-7776bb98-c5be-46ae-bc7e-cc4e42c8e0f5 service nova] Enqueued Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_members [ 1108.455717] env[69756]: INFO networking_nsxv3.common.synchronization [req-78727252-56e8-47a4-ac4b-39018a14a3aa req-7776bb98-c5be-46ae-bc7e-cc4e42c8e0f5 service nova] Enqueued Resource ID: 58ee1639-3131-42e9-a241-63b661e11ab4 with Priority: HIGHEST for action port [ 1108.455717] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_rules [ 1108.455717] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_members [ 1108.455717] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58ee1639-3131-42e9-a241-63b661e11ab4 with Priority: HIGHEST for action port [ 1108.455717] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.456017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.456017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.456173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.456380] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.457276] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.457886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.457954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.458158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.458355] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.458417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.458461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.458627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.458690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.458806] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.462495] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-58ee1639-3131-42e9-a241-63b661e11ab4 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.462495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58ee1639-3131-42e9-a241-63b661e11ab4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.462495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58ee1639-3131-42e9-a241-63b661e11ab4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.462495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58ee1639-3131-42e9-a241-63b661e11ab4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.462495] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58ee1639-3131-42e9-a241-63b661e11ab4',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.584419] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 in Status: SUCCESS [ 1108.588129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.588129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.588129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.588129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.588129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.588129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.588129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.588129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.588129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.588129] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.918447] env[69756]: INFO networking_nsxv3.common.synchronization [req-d6ff7dbc-bce4-42bd-aaeb-93b2c1d75df3 req-be7dbc0b-9892-4553-abe4-a0e178b7992a tempest-ServerMetadataNegativeTestJSON-2028735514 tempest-ServerMetadataNegativeTestJSON-2028735514-project-member] Enqueued Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGHEST for action security_group_members [ 1108.919048] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGHEST for action security_group_members [ 1108.919481] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77f0576f-4cd5-4be0-a66d-6284578fd001 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.919721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.919721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.919988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.920198] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.920334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.920425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.920636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.920751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.921110] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77f0576f-4cd5-4be0-a66d-6284578fd001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.963750] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.964900] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.965043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.965212] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58ee1639-3131-42e9-a241-63b661e11ab4 with status ACTIVE [ 1108.965374] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.965491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.965559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.966177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.966177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.966177] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.966177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.966349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.966378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.966534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.966624] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.966716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.966780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.967148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.967148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.970988] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58ee1639-3131-42e9-a241-63b661e11ab4 is going to be updated. [ 1108.994912] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.994912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.994912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.996518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.996518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.996518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58ee1639-3131-42e9-a241-63b661e11ab4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.078403] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 in Status: SUCCESS [ 1109.079383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.089077] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.423528] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.423871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.423871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.424073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.424171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.424378] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.424482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.424548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.424702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.424780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.424927] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 already deleted. [ 1109.425015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.472812] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.513579] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-198 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.513703] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-198" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.513909] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-198" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.514851] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-198" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.514851] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.514851] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.514851] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.515289] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.516035] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.516035] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.516035] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.516035] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.516035] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.516546] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.516546] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.516546] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.547753] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.547949] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1109.548174] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.548355] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-198" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.548686] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-cac465c2-6402-43df-8631-3fc7a1bb4fb9 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.548961] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-cac465c2-6402-43df-8631-3fc7a1bb4fb9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.549113] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-cac465c2-6402-43df-8631-3fc7a1bb4fb9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.549479] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-cac465c2-6402-43df-8631-3fc7a1bb4fb9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.549628] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cac465c2-6402-43df-8631-3fc7a1bb4fb9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.591130] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5: rpc.has_security_group_logging(os_id): False [ 1109.610724] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.610936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.611088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.611277] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.611373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.611615] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.611719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.611790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.611970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.612072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.612160] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 is going to be created. [ 1109.672149] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.672328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.672375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.672653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.672746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.689488] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 in Status: IN_PROGRESS for 2s [ 1109.982107] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.982256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.982327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.982589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.982679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.982775] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 is going to be created. [ 1110.009206] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.009348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.009408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.009619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.009772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.019939] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 in Status: UNINITIALIZED for 2s [ 1110.053866] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.053866] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.053866] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.054355] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.054498] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.054734] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port cac465c2-6402-43df-8631-3fc7a1bb4fb9 not found, creating... [ 1110.055178] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.057622] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.057822] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.058143] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.058310] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.058665] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.058846] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.058973] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.060077] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.060613] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.060864] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: cac465c2-6402-43df-8631-3fc7a1bb4fb9 is going to be created. [ 1110.093652] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.093785] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.093840] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.094192] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.094467] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.094770] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-cac465c2-6402-43df-8631-3fc7a1bb4fb9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.865384] env[69756]: INFO networking_nsxv3.common.synchronization [req-d6ff7dbc-bce4-42bd-aaeb-93b2c1d75df3 req-45cb8cea-bad8-43a2-a010-1cb9db79224c service nova] Enqueued Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGHEST for action security_group_rules [ 1110.866053] env[69756]: INFO networking_nsxv3.common.synchronization [req-d6ff7dbc-bce4-42bd-aaeb-93b2c1d75df3 req-45cb8cea-bad8-43a2-a010-1cb9db79224c service nova] Enqueued Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGHEST for action security_group_members [ 1110.866053] env[69756]: INFO networking_nsxv3.common.synchronization [req-d6ff7dbc-bce4-42bd-aaeb-93b2c1d75df3 req-45cb8cea-bad8-43a2-a010-1cb9db79224c service nova] Enqueued Resource ID: cac465c2-6402-43df-8631-3fc7a1bb4fb9 with Priority: HIGHEST for action port [ 1110.866053] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGHEST for action security_group_rules [ 1110.866167] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGHEST for action security_group_members [ 1110.866200] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac465c2-6402-43df-8631-3fc7a1bb4fb9 with Priority: HIGHEST for action port [ 1110.867901] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77f0576f-4cd5-4be0-a66d-6284578fd001 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.867901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.867901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.867901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.867901] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77f0576f-4cd5-4be0-a66d-6284578fd001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.868599] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77f0576f-4cd5-4be0-a66d-6284578fd001 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.868753] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.868825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.869589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.870194] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.870368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.870409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.870575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.870632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.870721] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77f0576f-4cd5-4be0-a66d-6284578fd001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.874429] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-cac465c2-6402-43df-8631-3fc7a1bb4fb9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.874429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cac465c2-6402-43df-8631-3fc7a1bb4fb9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.874429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cac465c2-6402-43df-8631-3fc7a1bb4fb9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.874429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cac465c2-6402-43df-8631-3fc7a1bb4fb9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.874429] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cac465c2-6402-43df-8631-3fc7a1bb4fb9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.370048] env[69756]: INFO networking_nsxv3.common.synchronization [req-77e20a85-b38f-4e03-b562-a88bead1b9e3 req-ddc1d0d1-43ba-4905-aa48-386c272919d1 tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1111.370048] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1111.370048] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.370048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.370048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.370356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.370498] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.370498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.370578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.370688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.370772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.370883] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.378215] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77f0576f-4cd5-4be0-a66d-6284578fd001 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.378215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.378215] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77f0576f-4cd5-4be0-a66d-6284578fd001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.378215] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cac465c2-6402-43df-8631-3fc7a1bb4fb9 with status ACTIVE [ 1111.378380] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.378432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.378472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.378647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.378786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.378916] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.379031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.379108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.379264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.379337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.379506] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.379590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.379645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.379778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.379846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.379924] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cac465c2-6402-43df-8631-3fc7a1bb4fb9 is going to be updated. [ 1111.403331] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.403481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.403554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.403771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.403913] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.404089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cac465c2-6402-43df-8631-3fc7a1bb4fb9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.706893] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 in Status: SUCCESS [ 1111.706893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.798178] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.798407] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.798541] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.798836] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.799138] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.799307] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.799432] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.799666] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.799818] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.803951] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.806673] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.806673] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.806673] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.806673] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.806673] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.806673] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.835081] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.835442] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1111.836030] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.836030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.836151] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-f4c20967-5d44-4d38-828e-5f993af8a88a taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.836308] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-f4c20967-5d44-4d38-828e-5f993af8a88a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.836441] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-f4c20967-5d44-4d38-828e-5f993af8a88a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.836841] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-f4c20967-5d44-4d38-828e-5f993af8a88a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.838711] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4c20967-5d44-4d38-828e-5f993af8a88a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.877068] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.877549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.877549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.877549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.877730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.878276] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.878276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.878276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.878276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.878529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.878700] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1111.881781] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77f0576f-4cd5-4be0-a66d-6284578fd001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.919456] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.919666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.919666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.919853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.919990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.932984] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1112.034234] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 in Status: SUCCESS [ 1112.034234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.034412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.034626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.034818] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.034966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.035052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.035215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.035308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.035395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.035483] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.341377] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.341562] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.341627] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.342347] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.342484] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.342655] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port f4c20967-5d44-4d38-828e-5f993af8a88a not found, creating... [ 1112.343125] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.343464] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.343464] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.343714] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.343860] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.344188] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.344821] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.344977] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.345220] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.345361] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.345634] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: f4c20967-5d44-4d38-828e-5f993af8a88a is going to be created. [ 1112.370239] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.370468] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.370588] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.370949] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.371289] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.371449] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-f4c20967-5d44-4d38-828e-5f993af8a88a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.385773] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.385983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.385983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.386211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.386299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.386385] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 is going to be created. [ 1112.414585] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.414778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.414824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.415048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.415196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.425696] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 in Status: UNINITIALIZED for 2s [ 1112.545140] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.047119] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0: rpc.has_security_group_logging(os_id): False [ 1113.068220] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.068525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.068525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.068748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.068947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.069227] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.069388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.069475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.069615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.069711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.069834] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 is going to be created. [ 1113.159647] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.159843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.159889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.160111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.160527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.174684] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 in Status: IN_PROGRESS for 2s [ 1113.925586] env[69756]: INFO networking_nsxv3.common.synchronization [req-77e20a85-b38f-4e03-b562-a88bead1b9e3 req-5471251c-47ad-412f-baed-4ce6188d63f3 service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 1113.925793] env[69756]: INFO networking_nsxv3.common.synchronization [req-77e20a85-b38f-4e03-b562-a88bead1b9e3 req-5471251c-47ad-412f-baed-4ce6188d63f3 service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1113.928521] env[69756]: INFO networking_nsxv3.common.synchronization [req-77e20a85-b38f-4e03-b562-a88bead1b9e3 req-5471251c-47ad-412f-baed-4ce6188d63f3 service nova] Enqueued Resource ID: f4c20967-5d44-4d38-828e-5f993af8a88a with Priority: HIGHEST for action port [ 1113.928521] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 1113.928521] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1113.928521] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4c20967-5d44-4d38-828e-5f993af8a88a with Priority: HIGHEST for action port [ 1113.929347] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.929347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.929347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.929716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.929716] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.930702] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.930807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.931198] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4c20967-5d44-4d38-828e-5f993af8a88a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.931551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4c20967-5d44-4d38-828e-5f993af8a88a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.931590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4c20967-5d44-4d38-828e-5f993af8a88a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.931811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4c20967-5d44-4d38-828e-5f993af8a88a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.931895] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4c20967-5d44-4d38-828e-5f993af8a88a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.950500] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1113.950500] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 1113.950500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.950500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.950500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.950500] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.950500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.950500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.950500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.950500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.950500] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.388871] env[69756]: INFO networking_nsxv3.common.synchronization [req-c7b5e6f6-d058-4e38-ab4e-ed9877a32ee2 req-30529f44-d91b-4908-ba39-8b800d766263 tempest-ServersV294TestFqdnHostnames-406915398 tempest-ServersV294TestFqdnHostnames-406915398-project-member] Enqueued Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_members [ 1114.388871] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_members [ 1114.389496] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7abf7f6-a856-4157-be54-ef99b007674f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.389778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.389961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.390382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.390657] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.390870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.391152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.391489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.391667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.391852] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.434601] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.435511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.436840] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 in Status: SUCCESS [ 1114.437226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.437297] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4c20967-5d44-4d38-828e-5f993af8a88a with status ACTIVE [ 1114.437537] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.437708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.437780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.438081] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.438267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.438638] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.438638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.438809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.438848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.438936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.445023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.445023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.445023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.445023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.445023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.445023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4c20967-5d44-4d38-828e-5f993af8a88a is going to be updated. [ 1114.445023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.445023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.445023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.445023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.445023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.446404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.446673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.446892] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.447120] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77f0576f-4cd5-4be0-a66d-6284578fd001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.454491] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.474050] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.474050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.474050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.474050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.474050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.474050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4c20967-5d44-4d38-828e-5f993af8a88a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.755994] env[69756]: INFO networking_nsxv3.common.synchronization [None req-d2d21fe5-7b8c-42b6-941b-f88135e96a8c None None] Enqueued Resource ID: 65f90542-af8d-4d5c-9a11-418873e6fad7 with Priority: HIGHEST for action port [ 1114.756689] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65f90542-af8d-4d5c-9a11-418873e6fad7 with Priority: HIGHEST for action port [ 1114.757061] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-65f90542-af8d-4d5c-9a11-418873e6fad7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.757227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65f90542-af8d-4d5c-9a11-418873e6fad7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.757319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65f90542-af8d-4d5c-9a11-418873e6fad7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.757648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65f90542-af8d-4d5c-9a11-418873e6fad7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.757713] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65f90542-af8d-4d5c-9a11-418873e6fad7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.863426] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-101 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.863811] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-101" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.863811] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-101" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.864160] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-101" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.864530] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.865054] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.865142] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.865509] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.867324] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.867324] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.867324] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.867324] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.868010] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.868010] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.868205] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.868671] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.889484] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.890115] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.890360] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.890618] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-101" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.891054] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-c693db7a-492a-4a88-881c-0ab06312cd57 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.891260] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-c693db7a-492a-4a88-881c-0ab06312cd57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.891387] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-c693db7a-492a-4a88-881c-0ab06312cd57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.891749] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-c693db7a-492a-4a88-881c-0ab06312cd57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.891920] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c693db7a-492a-4a88-881c-0ab06312cd57',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.896025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.896025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.896025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.896025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.896025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.896417] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.896472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.896503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.896686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.896765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.896849] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7abf7f6-a856-4157-be54-ef99b007674f already deleted. [ 1114.896927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.951227] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77f0576f-4cd5-4be0-a66d-6284578fd001 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.951515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.951898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.952275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.952658] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.953027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.953150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.953412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.953558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.953710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.953967] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77f0576f-4cd5-4be0-a66d-6284578fd001 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.954151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.954263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.954495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.954719] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.954886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.954970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.955547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.956050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.956050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.956175] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77f0576f-4cd5-4be0-a66d-6284578fd001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.957640] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.188467] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 in Status: SUCCESS [ 1115.195029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.260391] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65f90542-af8d-4d5c-9a11-418873e6fad7 [ 1115.260626] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.260790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.260865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.261208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.261337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.261463] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65f90542-af8d-4d5c-9a11-418873e6fad7 already deleted. [ 1115.261569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65f90542-af8d-4d5c-9a11-418873e6fad7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.396125] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.396125] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.396576] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.396665] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.396918] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.397187] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port c693db7a-492a-4a88-881c-0ab06312cd57 not found, creating... [ 1115.397615] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.399431] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.401849] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.402319] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.402511] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.402845] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.403030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.403160] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.403446] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.403636] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.403789] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: c693db7a-492a-4a88-881c-0ab06312cd57 is going to be created. [ 1115.429041] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.429041] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.429041] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.429041] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.429041] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.429041] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-c693db7a-492a-4a88-881c-0ab06312cd57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.460858] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.461098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.461180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.461388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.461477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.461576] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1115.462758] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77f0576f-4cd5-4be0-a66d-6284578fd001: rpc.has_security_group_logging(os_id): False [ 1115.487797] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.489442] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.489442] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.489442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.489868] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.489868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.489868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.489868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.489984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.489984] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 is going to be created. [ 1115.517352] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.522140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.522324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.522737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.522737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.542640] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1115.594152] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.594330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.594410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.594624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.594803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.608820] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 in Status: IN_PROGRESS for 2s [ 1115.654984] env[69756]: INFO networking_nsxv3.common.synchronization [req-51973af2-575a-4302-ae26-41039532a8f0 req-4e81f9cc-f83e-4521-b650-16e4197fa268 tempest-MigrationsAdminTest-188051455 tempest-MigrationsAdminTest-188051455-project-member] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 1115.655541] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGHEST for action security_group_members [ 1115.655844] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.655972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.656040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.657024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.657024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.657024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.657024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.657024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.657024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.657024] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.158966] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.158966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.158966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.159261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.159300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.159884] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.159884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.159884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.159884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.159884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.161119] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9593-3500-4c12-99da-d35935a142b3 is going to be updated. [ 1116.197178] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.197768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.198556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.199569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.199960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.231276] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: IN_PROGRESS for 2s [ 1116.540871] env[69756]: INFO networking_nsxv3.common.synchronization [req-c7b5e6f6-d058-4e38-ab4e-ed9877a32ee2 req-a4d7b0ef-a30e-4083-bc68-b518f41a62d4 service nova] Enqueued Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_rules [ 1116.540871] env[69756]: INFO networking_nsxv3.common.synchronization [req-c7b5e6f6-d058-4e38-ab4e-ed9877a32ee2 req-a4d7b0ef-a30e-4083-bc68-b518f41a62d4 service nova] Enqueued Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_members [ 1116.540871] env[69756]: INFO networking_nsxv3.common.synchronization [req-c7b5e6f6-d058-4e38-ab4e-ed9877a32ee2 req-a4d7b0ef-a30e-4083-bc68-b518f41a62d4 service nova] Enqueued Resource ID: c693db7a-492a-4a88-881c-0ab06312cd57 with Priority: HIGHEST for action port [ 1116.541435] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_rules [ 1116.541789] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_members [ 1116.541943] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c693db7a-492a-4a88-881c-0ab06312cd57 with Priority: HIGHEST for action port [ 1116.542466] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7abf7f6-a856-4157-be54-ef99b007674f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.542466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.542466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.542712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.542772] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.544459] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7abf7f6-a856-4157-be54-ef99b007674f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.544552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.544552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.544745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.545126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.545221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.545324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.546405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.546405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.546405] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.546776] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c693db7a-492a-4a88-881c-0ab06312cd57 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.546941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c693db7a-492a-4a88-881c-0ab06312cd57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.547015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c693db7a-492a-4a88-881c-0ab06312cd57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.547157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c693db7a-492a-4a88-881c-0ab06312cd57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.547226] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c693db7a-492a-4a88-881c-0ab06312cd57',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.995153] env[69756]: INFO networking_nsxv3.common.synchronization [req-6d8851b7-ce34-4682-9fa6-e9719b259b80 req-285efefb-b1d8-438f-92d1-a438461fd542 tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1116.995608] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1116.995818] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.995961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.996052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.996487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.996487] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.996487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.996718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.996718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.996819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.996819] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.045318] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7abf7f6-a856-4157-be54-ef99b007674f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.045484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.048277] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.049257] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c693db7a-492a-4a88-881c-0ab06312cd57 with status ACTIVE [ 1117.051612] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.052126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.052226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.052469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.052612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.052838] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.052981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.053078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.053392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.053517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.053733] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.055525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.058019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.058019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.058019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.058019] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c693db7a-492a-4a88-881c-0ab06312cd57 is going to be updated. [ 1117.081114] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.081114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.081114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.081114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.081114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.081114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c693db7a-492a-4a88-881c-0ab06312cd57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.134607] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e29dd91f-fba3-4f5b-b1ef-353785a6f379 None None] Enqueued Resource ID: 91ddb8c5-ba84-48f9-b76f-5da431cbfb33 with Priority: HIGHEST for action port [ 1117.135472] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91ddb8c5-ba84-48f9-b76f-5da431cbfb33 with Priority: HIGHEST for action port [ 1117.135792] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-91ddb8c5-ba84-48f9-b76f-5da431cbfb33 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.135915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91ddb8c5-ba84-48f9-b76f-5da431cbfb33" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.135983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91ddb8c5-ba84-48f9-b76f-5da431cbfb33" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.139487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91ddb8c5-ba84-48f9-b76f-5da431cbfb33" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.139487] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ddb8c5-ba84-48f9-b76f-5da431cbfb33',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.499375] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.554894] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1117.555251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.555352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.555571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.555762] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.555875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.555941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.556207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.556207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.556305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.556346] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.557920] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.621858] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 in Status: SUCCESS [ 1117.621858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.644899] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91ddb8c5-ba84-48f9-b76f-5da431cbfb33 [ 1117.644899] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.644899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.644899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.644899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.644899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.644899] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91ddb8c5-ba84-48f9-b76f-5da431cbfb33 already deleted. [ 1117.644899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91ddb8c5-ba84-48f9-b76f-5da431cbfb33" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.654020] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.654020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.654020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.654020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.654020] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.654020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.654020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.654603] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.657963] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.657963] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.657963] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.657963] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.657963] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.657963] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.657963] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.657963] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.678023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.678023] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1117.678023] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.678023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.678023] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-bef0e458-f802-4f86-9084-a74d7c64f8ea taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.678023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-bef0e458-f802-4f86-9084-a74d7c64f8ea" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.678023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-bef0e458-f802-4f86-9084-a74d7c64f8ea" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.678023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-bef0e458-f802-4f86-9084-a74d7c64f8ea" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.678023] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bef0e458-f802-4f86-9084-a74d7c64f8ea',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.002457] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.059232] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.059496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.059496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.059713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.059898] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.060059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.060108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.060252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.060346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.060438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.060594] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.060732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.060862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.061148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.061324] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.061427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.061490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.061693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.061803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.061960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.062161] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.063755] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.063869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.063932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.064175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.064286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.064426] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7abf7f6-a856-4157-be54-ef99b007674f is going to be created. [ 1118.100263] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.100491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.100491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.101076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.101076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.112173] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7abf7f6-a856-4157-be54-ef99b007674f in Status: UNINITIALIZED for 2s [ 1118.180738] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.181100] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.181260] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.181564] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.181719] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.181894] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port bef0e458-f802-4f86-9084-a74d7c64f8ea not found, creating... [ 1118.182301] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.182476] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.182601] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.182847] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.182998] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.183325] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.183493] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.183617] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.184705] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.184954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.185164] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: bef0e458-f802-4f86-9084-a74d7c64f8ea is going to be created. [ 1118.216590] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.216946] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.217146] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.217486] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.217814] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.218103] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-bef0e458-f802-4f86-9084-a74d7c64f8ea" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.243988] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9593-3500-4c12-99da-d35935a142b3 in Status: SUCCESS [ 1118.244275] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9593-3500-4c12-99da-d35935a142b3 deletion is rescheduled due to dependency. [ 1118.244408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.509122] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.509122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.509122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.509122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.509122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.509122] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1118.545275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.545275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.545275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.545275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.545275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.564768] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1118.567328] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d711ed5-98da-4810-9f03-9148ad645008: rpc.has_security_group_logging(os_id): False [ 1118.588442] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.589013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.589013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.589152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.589245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.589616] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.589882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.589882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.590999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.590999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.590999] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.590999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.590999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.594601] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.594778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.595074] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.595236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.595309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.595914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.595914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.595914] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1118.679918] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.679918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.680072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.680249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.680330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.700206] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1119.154255] env[69756]: INFO networking_nsxv3.common.synchronization [req-6d8851b7-ce34-4682-9fa6-e9719b259b80 req-e26a27fd-6a19-4e8a-af86-23f0212f8e2e service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 1119.154255] env[69756]: INFO networking_nsxv3.common.synchronization [req-6d8851b7-ce34-4682-9fa6-e9719b259b80 req-e26a27fd-6a19-4e8a-af86-23f0212f8e2e service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1119.154340] env[69756]: INFO networking_nsxv3.common.synchronization [req-6d8851b7-ce34-4682-9fa6-e9719b259b80 req-e26a27fd-6a19-4e8a-af86-23f0212f8e2e service nova] Enqueued Resource ID: bef0e458-f802-4f86-9084-a74d7c64f8ea with Priority: HIGHEST for action port [ 1119.154878] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 1119.155689] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1119.155689] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef0e458-f802-4f86-9084-a74d7c64f8ea with Priority: HIGHEST for action port [ 1119.155689] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.155689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.155689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.157828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.157828] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.157828] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.157828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.157828] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-bef0e458-f802-4f86-9084-a74d7c64f8ea taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.157828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bef0e458-f802-4f86-9084-a74d7c64f8ea" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.157828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bef0e458-f802-4f86-9084-a74d7c64f8ea" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.157828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bef0e458-f802-4f86-9084-a74d7c64f8ea" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.157828] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bef0e458-f802-4f86-9084-a74d7c64f8ea',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.660980] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.660980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.663284] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bef0e458-f802-4f86-9084-a74d7c64f8ea with status ACTIVE [ 1119.663516] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.663649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.663719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.663936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.664039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.664223] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.664345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.664401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.664564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.664635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.664814] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.664906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.665008] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.665142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.665220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.665314] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bef0e458-f802-4f86-9084-a74d7c64f8ea is going to be updated. [ 1119.687129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.687325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.687423] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.687664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.687855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.688066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bef0e458-f802-4f86-9084-a74d7c64f8ea" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.124838] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7abf7f6-a856-4157-be54-ef99b007674f in Status: SUCCESS [ 1120.124838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.124838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.124838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.124838] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.124838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.124838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.124838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.124838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.124838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.124838] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.463192] env[69756]: INFO networking_nsxv3.common.synchronization [req-99949a29-2f52-4a2b-bdda-dcd040cf1960 req-0817915c-dbe8-4776-b390-30d4d71992b0 tempest-FloatingIPsAssociationTestJSON-1590966768 tempest-FloatingIPsAssociationTestJSON-1590966768-project-member] Enqueued Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1120.463898] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGHEST for action security_group_members [ 1120.464745] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.464942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.465104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.465390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.465781] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.465953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.466111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.466383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.466718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.466875] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.579847] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1120.580292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.580940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.581355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.581696] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.581948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.583019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.583019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.583019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.583019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.632125] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.716586] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1120.716586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.969481] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.969913] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.969983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.970242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.970346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.970547] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.970655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.970947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.971101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.971199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.972702] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e923000-de4f-4614-8d9f-829896824884 is going to be updated. [ 1121.008666] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.008666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.008666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.008666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.008666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.020316] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: IN_PROGRESS for 2s [ 1121.085256] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.136737] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7abf7f6-a856-4157-be54-ef99b007674f: rpc.has_security_group_logging(os_id): False [ 1121.157620] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.157790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.157838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.158123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.158185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.158381] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.158482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.158545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.158698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.158769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.158852] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7abf7f6-a856-4157-be54-ef99b007674f is going to be created. [ 1121.238916] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.239148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.239220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.239430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.239621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.254347] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7abf7f6-a856-4157-be54-ef99b007674f in Status: IN_PROGRESS for 2s [ 1121.587681] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.089910] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.092121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.092121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.092121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.092121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.092121] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1122.129251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.129251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.129251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.131393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.131393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.147152] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1122.323108] env[69756]: INFO networking_nsxv3.common.synchronization [req-cc8b05e9-bf7f-4015-95d6-be6dc42ed41d req-d507f135-2f01-4452-8b8a-099aaa937b6e tempest-InstanceActionsV221TestJSON-1853085965 tempest-InstanceActionsV221TestJSON-1853085965-project-member] Enqueued Resource ID: 70b83947-df81-4c26-945b-c5d14986de4a with Priority: HIGHEST for action security_group_members [ 1122.323665] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b83947-df81-4c26-945b-c5d14986de4a with Priority: HIGHEST for action security_group_members [ 1122.324426] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b83947-df81-4c26-945b-c5d14986de4a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.325868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.325967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.326329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.326570] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.326667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.326717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.326860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.326945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.327056] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70b83947-df81-4c26-945b-c5d14986de4a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.834375] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.834375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.834375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.838078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.838240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.838888] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.839033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.839033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.839334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.839432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.839534] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b83947-df81-4c26-945b-c5d14986de4a already deleted. [ 1122.840018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.029634] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e923000-de4f-4614-8d9f-829896824884 in Status: SUCCESS [ 1123.030358] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e923000-de4f-4614-8d9f-829896824884 deletion is rescheduled due to dependency. [ 1123.030358] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.053702] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.053885] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-848" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.053945] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-848" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.054519] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-848" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.054685] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.054908] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.055384] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.055692] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.055925] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.056229] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.056389] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.056543] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.056959] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.057143] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.057935] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.058210] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.085205] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.085205] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1123.085205] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.085205] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-848" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.085205] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-dc9f0086-69b3-43e7-a1af-acb162bca4e8 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.085205] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-dc9f0086-69b3-43e7-a1af-acb162bca4e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.085205] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-dc9f0086-69b3-43e7-a1af-acb162bca4e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.085205] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-dc9f0086-69b3-43e7-a1af-acb162bca4e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.085205] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc9f0086-69b3-43e7-a1af-acb162bca4e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.271994] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7abf7f6-a856-4157-be54-ef99b007674f in Status: SUCCESS [ 1123.271994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.589700] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.589924] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.590068] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.590898] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.590898] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.590898] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port dc9f0086-69b3-43e7-a1af-acb162bca4e8 not found, creating... [ 1123.591138] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.591138] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.591271] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.591491] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.591624] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.591916] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.592192] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.592389] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.593076] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.593076] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.593076] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: dc9f0086-69b3-43e7-a1af-acb162bca4e8 is going to be created. [ 1123.619654] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.619860] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.619988] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.620299] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.620526] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.620746] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-dc9f0086-69b3-43e7-a1af-acb162bca4e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.158996] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1124.159245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.159625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.159625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.160538] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.160538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.160538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.160538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.160538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.160538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.160538] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.471304] env[69756]: INFO networking_nsxv3.common.synchronization [req-cc8b05e9-bf7f-4015-95d6-be6dc42ed41d req-1df97dec-b85c-4028-8edc-3093556b3285 service nova] Enqueued Resource ID: 70b83947-df81-4c26-945b-c5d14986de4a with Priority: HIGHEST for action security_group_rules [ 1124.471304] env[69756]: INFO networking_nsxv3.common.synchronization [req-cc8b05e9-bf7f-4015-95d6-be6dc42ed41d req-1df97dec-b85c-4028-8edc-3093556b3285 service nova] Enqueued Resource ID: 70b83947-df81-4c26-945b-c5d14986de4a with Priority: HIGHEST for action security_group_members [ 1124.471782] env[69756]: INFO networking_nsxv3.common.synchronization [req-cc8b05e9-bf7f-4015-95d6-be6dc42ed41d req-1df97dec-b85c-4028-8edc-3093556b3285 service nova] Enqueued Resource ID: dc9f0086-69b3-43e7-a1af-acb162bca4e8 with Priority: HIGHEST for action port [ 1124.472568] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b83947-df81-4c26-945b-c5d14986de4a with Priority: HIGHEST for action security_group_rules [ 1124.472641] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b83947-df81-4c26-945b-c5d14986de4a with Priority: HIGHEST for action security_group_members [ 1124.472809] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9f0086-69b3-43e7-a1af-acb162bca4e8 with Priority: HIGHEST for action port [ 1124.473219] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70b83947-df81-4c26-945b-c5d14986de4a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.473432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.473551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.473856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.474151] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70b83947-df81-4c26-945b-c5d14986de4a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.475016] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b83947-df81-4c26-945b-c5d14986de4a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.478933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.478933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.478933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.478933] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.478933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.478933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.478933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.478933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.478933] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70b83947-df81-4c26-945b-c5d14986de4a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.478933] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc9f0086-69b3-43e7-a1af-acb162bca4e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.480153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc9f0086-69b3-43e7-a1af-acb162bca4e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.480235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc9f0086-69b3-43e7-a1af-acb162bca4e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.480389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc9f0086-69b3-43e7-a1af-acb162bca4e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.480466] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc9f0086-69b3-43e7-a1af-acb162bca4e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.669070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.669070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.669070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.669070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.669070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.669692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.669692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.669692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.669692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.669692] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.985027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b83947-df81-4c26-945b-c5d14986de4a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.985027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.985027] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70b83947-df81-4c26-945b-c5d14986de4a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.985765] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc9f0086-69b3-43e7-a1af-acb162bca4e8 with status ACTIVE [ 1124.985765] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.985995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.985995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.986114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.986203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.987124] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.987285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.987373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.987610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.987853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.988115] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.988252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.988366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.990370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.990699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.990844] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc9f0086-69b3-43e7-a1af-acb162bca4e8 is going to be updated. [ 1125.021189] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.021381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.021451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.021691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.021897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.022119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc9f0086-69b3-43e7-a1af-acb162bca4e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.173836] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48c09f21-41e5-4def-8d66-8a36711be55a: rpc.has_security_group_logging(os_id): False [ 1125.197013] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.197286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.197286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.197570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.197708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.197946] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.198064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.198132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.198498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.198498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.198611] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.198663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.198731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.198869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.198941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.199544] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.199701] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.199701] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.199850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.199924] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.200017] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1125.288576] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.288729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.289836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.289836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.289836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.309422] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1125.493077] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70b83947-df81-4c26-945b-c5d14986de4a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.813595] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-625 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.813807] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.813938] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.814227] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.814850] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.815180] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.815358] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.815626] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.815825] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.816879] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.817240] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.817781] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.817781] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.817781] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.817781] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.817994] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.839341] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.839604] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1125.839733] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.839925] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-625" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.840268] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.840463] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.840602] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.840902] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.841692] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.999896] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.999896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.999896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.999896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.999896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.999896] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b83947-df81-4c26-945b-c5d14986de4a is going to be created. [ 1126.032669] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.032867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.032933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.035046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.035046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.047038] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b83947-df81-4c26-945b-c5d14986de4a in Status: UNINITIALIZED for 2s [ 1126.346108] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.346108] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.346108] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.346412] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.346574] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.346928] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.347118] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.347246] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.347729] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.348209] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.349127] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.349127] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.352029] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.353040] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.353040] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.353040] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 is going to be updated. [ 1126.387017] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.387017] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.387017] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.387313] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.387366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.388149] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.223051] env[69756]: INFO networking_nsxv3.common.synchronization [req-05771101-5125-4ccf-afc1-95a2a5ed33d2 req-00083a74-99ef-4d5d-8262-f0c6675427c9 service nova] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_rules [ 1127.223051] env[69756]: INFO networking_nsxv3.common.synchronization [req-05771101-5125-4ccf-afc1-95a2a5ed33d2 req-00083a74-99ef-4d5d-8262-f0c6675427c9 service nova] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 1127.223625] env[69756]: INFO networking_nsxv3.common.synchronization [req-05771101-5125-4ccf-afc1-95a2a5ed33d2 req-00083a74-99ef-4d5d-8262-f0c6675427c9 service nova] Enqueued Resource ID: c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 with Priority: HIGHEST for action port [ 1127.223731] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_rules [ 1127.223872] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 1127.223973] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 with Priority: HIGHEST for action port [ 1127.224634] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.224769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.224895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.225076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.225176] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.226276] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.226431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.226506] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.226675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.226823] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.226978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.226978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.227147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.227234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.227320] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.228164] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.228267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.228353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.228492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.228570] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.330362] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1127.330665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.731503] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 with status ACTIVE [ 1127.731767] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.731887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.731887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.732263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.732411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.733162] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.733162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.733162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.733162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.733162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.733162] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.733162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.733672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.733672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.733672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.733672] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7 is going to be updated. [ 1127.734792] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.735869] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.736026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.766834] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.767264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.767346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.767559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.767698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.767866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4d7c4f8-9ca6-4b2c-bf50-27142607e4e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.062077] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b83947-df81-4c26-945b-c5d14986de4a in Status: SUCCESS [ 1128.062418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.062512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.062725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.062952] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.063087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.063132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.063287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.063373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.063473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.063578] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70b83947-df81-4c26-945b-c5d14986de4a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.237029] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.570812] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b83947-df81-4c26-945b-c5d14986de4a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.571020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.571020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.571424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.571679] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.572211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.572211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.572211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.572354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.572973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.574487] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b83947-df81-4c26-945b-c5d14986de4a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.574487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.575407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.575653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.575886] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.576189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.576189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.576563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.576563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.576666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.576926] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70b83947-df81-4c26-945b-c5d14986de4a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.739656] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.739828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.739900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.740139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.740228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.740328] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be updated. [ 1128.777718] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.777718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.777718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.777718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.777718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.784446] env[69756]: INFO networking_nsxv3.common.synchronization [req-a7fa062d-d2bd-401f-914e-1c2f4c780562 req-e7970c7d-a826-43cd-9ecc-8101580b6fa5 tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1128.785144] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1128.785840] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.785840] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.785840] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.786047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.786119] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.787055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.787223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.787442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.787562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.787904] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.794460] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: IN_PROGRESS for 2s [ 1129.080830] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70b83947-df81-4c26-945b-c5d14986de4a: rpc.has_security_group_logging(os_id): False [ 1129.091030] env[69756]: INFO networking_nsxv3.common.synchronization [req-bfc87310-09bc-4161-92ff-1ebbb98c3220 req-8d18ac74-73db-4fca-b56d-040c74397a54 tempest-ServerMetadataNegativeTestJSON-2028735514 tempest-ServerMetadataNegativeTestJSON-2028735514-project-member] Enqueued Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGHEST for action security_group_members [ 1129.091030] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGHEST for action security_group_members [ 1129.091030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77f0576f-4cd5-4be0-a66d-6284578fd001 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.091030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.091030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.091030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.091030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.091030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.091030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.091030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.091030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.091030] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77f0576f-4cd5-4be0-a66d-6284578fd001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.103130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.103130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.103130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.103130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.103130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.103130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.103130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.103130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.103462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.103462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.103538] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.103630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.103690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.103829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.103897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.104095] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.104184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.104241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.104379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.104447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.104527] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70b83947-df81-4c26-945b-c5d14986de4a is going to be created. [ 1129.183220] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.183220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.183220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.183220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.183220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.207060] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70b83947-df81-4c26-945b-c5d14986de4a in Status: IN_PROGRESS for 2s [ 1129.293793] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.295718] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.295911] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.296099] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.296336] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.296610] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.296759] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.296880] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.297113] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.297260] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.298371] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.298536] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.303353] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.303448] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.303572] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.303699] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.303856] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.337819] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.337819] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1129.337929] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.338164] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.338484] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-99de73aa-330b-473b-9218-217e47c0ce31 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.338675] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-99de73aa-330b-473b-9218-217e47c0ce31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.338804] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-99de73aa-330b-473b-9218-217e47c0ce31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.339230] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-99de73aa-330b-473b-9218-217e47c0ce31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.339390] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99de73aa-330b-473b-9218-217e47c0ce31',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.593067] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.593322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.593918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.594189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.594295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.594521] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.594657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.594754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.594975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.595119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.595258] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 is going to be updated. [ 1129.630031] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.630031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.630031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.630031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.630031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.641597] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 in Status: IN_PROGRESS for 2s [ 1129.806634] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.846526] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.846774] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.846912] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.847271] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.847523] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.847685] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 99de73aa-330b-473b-9218-217e47c0ce31 not found, creating... [ 1129.847814] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.847958] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.848101] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.848342] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.848515] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.848805] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.848988] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.849096] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.849323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.849461] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.849607] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 99de73aa-330b-473b-9218-217e47c0ce31 is going to be created. [ 1129.873625] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.874012] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.874197] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.874867] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.874867] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.875027] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-99de73aa-330b-473b-9218-217e47c0ce31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.121204] env[69756]: INFO networking_nsxv3.common.synchronization [None req-29d5c1d3-bd80-4853-ace5-429448661f82 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_rules [ 1130.121534] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_rules [ 1130.122482] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.123061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.123061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.123264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.123264] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.311906] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.311906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.311906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.311906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.311906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.311906] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1130.331679] env[69756]: INFO networking_nsxv3.common.synchronization [None req-c06ad241-51d5-42fd-a8c4-da8f3e8949d3 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_rules [ 1130.333046] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_rules [ 1130.333637] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.333987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.346490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.346490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.346490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.348051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.349061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.360129] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1130.647041] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.647279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.647370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.647671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.647787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.647882] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 already deleted. [ 1130.647962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.648123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.648307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.648386] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.808539] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: SUCCESS [ 1130.808539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.808835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.808971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.809349] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.809490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.809557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.809756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.809846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.809938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.810161] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.925080] env[69756]: INFO networking_nsxv3.common.synchronization [req-a7fa062d-d2bd-401f-914e-1c2f4c780562 req-01c45c1b-6b58-4aa0-a674-f4a940ea2f11 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 1130.925411] env[69756]: INFO networking_nsxv3.common.synchronization [req-a7fa062d-d2bd-401f-914e-1c2f4c780562 req-01c45c1b-6b58-4aa0-a674-f4a940ea2f11 service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1130.925851] env[69756]: INFO networking_nsxv3.common.synchronization [req-a7fa062d-d2bd-401f-914e-1c2f4c780562 req-01c45c1b-6b58-4aa0-a674-f4a940ea2f11 service nova] Enqueued Resource ID: 99de73aa-330b-473b-9218-217e47c0ce31 with Priority: HIGHEST for action port [ 1130.926818] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 1130.927439] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1130.927683] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99de73aa-330b-473b-9218-217e47c0ce31 with Priority: HIGHEST for action port [ 1130.928027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.929610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.929610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.929783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.930088] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.932028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.932028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.932028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-99de73aa-330b-473b-9218-217e47c0ce31 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.932028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99de73aa-330b-473b-9218-217e47c0ce31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.932028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99de73aa-330b-473b-9218-217e47c0ce31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.932028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99de73aa-330b-473b-9218-217e47c0ce31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.932028] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99de73aa-330b-473b-9218-217e47c0ce31',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.177339] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.177339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.177339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.177554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.177554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.177611] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 already deleted. [ 1131.177761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.230859] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70b83947-df81-4c26-945b-c5d14986de4a in Status: SUCCESS [ 1131.231328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.315192] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.315518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.315518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.315696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.315902] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.316037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.316113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.316286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.316411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.316484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.316690] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.318014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.318014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.318014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.318014] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.318014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.318014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.318014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.318014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.318014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.318014] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.434453] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.435203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.438021] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99de73aa-330b-473b-9218-217e47c0ce31 with status ACTIVE [ 1131.438021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.438021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.438021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.438021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.438021] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99de73aa-330b-473b-9218-217e47c0ce31 is going to be updated. [ 1131.466321] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.467083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.467083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.467083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.467267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.467374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99de73aa-330b-473b-9218-217e47c0ce31" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.654984] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 in Status: SUCCESS [ 1131.655239] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 deletion is rescheduled due to dependency. [ 1131.655350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.661695] env[69756]: INFO networking_nsxv3.common.synchronization [req-4d224605-f7df-4f83-93db-7c5e3bd183d0 req-04b43cc4-39dc-4ebf-a2d2-12e3624312f1 tempest-ServerAddressesNegativeTestJSON-280619649 tempest-ServerAddressesNegativeTestJSON-280619649-project-member] Enqueued Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGHEST for action security_group_members [ 1131.662425] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGHEST for action security_group_members [ 1131.662806] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a1544a-4fd5-4e41-87b3-73a71a6e4689 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.662981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.664105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.664105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.664105] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.664105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.664105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.664409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.664409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.664409] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a1544a-4fd5-4e41-87b3-73a71a6e4689',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.821750] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 285c5000-ac60-42b0-8441-f857f98438d0: rpc.has_security_group_logging(os_id): False [ 1131.845660] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.845660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.845660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.845660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.869967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.870110] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.870878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.870878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.870878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.870878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.870878] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.871185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.871185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.871185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.871393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.871782] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.871782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.871930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.872061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.872143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.872235] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be updated. [ 1132.076255] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.076401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.079881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.079881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.079881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.096481] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: IN_PROGRESS for 2s [ 1132.171108] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.171532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.171532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.171704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.171797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.171999] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.172212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.172212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.172399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.172474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.172579] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 already deleted. [ 1132.172660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.232818] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.236965] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-167" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.237321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-167" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.238246] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-167" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.238744] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.239048] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.239254] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.239527] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.239768] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.240088] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.240256] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.240428] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.240600] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.240786] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.240975] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.245372] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.275284] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.275446] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1132.275579] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.275765] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-167" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.276130] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-1e90ebb2-af1f-4a75-b636-02569dce97b6 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.276314] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-1e90ebb2-af1f-4a75-b636-02569dce97b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.276427] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-1e90ebb2-af1f-4a75-b636-02569dce97b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.276784] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-1e90ebb2-af1f-4a75-b636-02569dce97b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.276927] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e90ebb2-af1f-4a75-b636-02569dce97b6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.374360] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1132.374838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.374838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.375053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.375338] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.375656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.375826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.376200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.376365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.376500] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.780404] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.780736] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.780736] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.781280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.781513] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.781722] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 1e90ebb2-af1f-4a75-b636-02569dce97b6 not found, creating... [ 1132.782048] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.782259] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.782426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.782632] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.782792] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.783166] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.783346] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.783530] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.783795] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.783945] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.784120] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 1e90ebb2-af1f-4a75-b636-02569dce97b6 is going to be created. [ 1132.809587] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.809587] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.809587] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.809587] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.809587] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.809587] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-1e90ebb2-af1f-4a75-b636-02569dce97b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.880838] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.385816] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.682396] env[69756]: INFO networking_nsxv3.common.synchronization [req-4d224605-f7df-4f83-93db-7c5e3bd183d0 req-623dfce2-63e3-41fd-8a1d-c3d1a48de2af service nova] Enqueued Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGHEST for action security_group_rules [ 1133.682566] env[69756]: INFO networking_nsxv3.common.synchronization [req-4d224605-f7df-4f83-93db-7c5e3bd183d0 req-623dfce2-63e3-41fd-8a1d-c3d1a48de2af service nova] Enqueued Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGHEST for action security_group_members [ 1133.682615] env[69756]: INFO networking_nsxv3.common.synchronization [req-4d224605-f7df-4f83-93db-7c5e3bd183d0 req-623dfce2-63e3-41fd-8a1d-c3d1a48de2af service nova] Enqueued Resource ID: 1e90ebb2-af1f-4a75-b636-02569dce97b6 with Priority: HIGHEST for action port [ 1133.683195] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGHEST for action security_group_rules [ 1133.683333] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGHEST for action security_group_members [ 1133.683437] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e90ebb2-af1f-4a75-b636-02569dce97b6 with Priority: HIGHEST for action port [ 1133.683717] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.683856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.683935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.684189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.684277] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a1544a-4fd5-4e41-87b3-73a71a6e4689',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.685205] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a1544a-4fd5-4e41-87b3-73a71a6e4689 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.685345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.685345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.685501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.685640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.685752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.685826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.685918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.686207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.686207] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a1544a-4fd5-4e41-87b3-73a71a6e4689',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.686856] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e90ebb2-af1f-4a75-b636-02569dce97b6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.687011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e90ebb2-af1f-4a75-b636-02569dce97b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.687093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e90ebb2-af1f-4a75-b636-02569dce97b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.687183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e90ebb2-af1f-4a75-b636-02569dce97b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.687253] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e90ebb2-af1f-4a75-b636-02569dce97b6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.890098] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.890338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.890414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.890697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.890827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.890948] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1133.952809] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.952809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.952809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.952809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.952809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.971843] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1134.117987] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: SUCCESS [ 1134.117987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.188633] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a1544a-4fd5-4e41-87b3-73a71a6e4689 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.188955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.191408] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28a1544a-4fd5-4e41-87b3-73a71a6e4689',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.192494] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e90ebb2-af1f-4a75-b636-02569dce97b6 with status ACTIVE [ 1134.193218] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.193385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.193469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.193696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.193795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.196110] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.196110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.196110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.196110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.196110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.196110] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.196110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.196110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.196110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.196110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.196110] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e90ebb2-af1f-4a75-b636-02569dce97b6 is going to be updated. [ 1134.245594] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.245594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.245594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.245594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.245594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.245594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e90ebb2-af1f-4a75-b636-02569dce97b6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.700504] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28a1544a-4fd5-4e41-87b3-73a71a6e4689',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.204680] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.204884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.204930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.205162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.205254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.205355] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 is going to be created. [ 1135.240961] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.241116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.241157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.241498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.241575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.260588] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 in Status: UNINITIALIZED for 2s [ 1135.981318] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1135.981670] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.981730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.981948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.982191] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.982376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.982376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.982571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.982626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.982705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.982798] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.470614] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-9d2a882d-b865-4dab-9629-9e255d79b35c tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1136.470614] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1136.470799] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.470870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.470961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.471368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.471475] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.472228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.472228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.472228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.472228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.472228] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.488505] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.488657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.488727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.489117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.489458] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.489639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.489756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.489945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.490050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.490145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.490301] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.490401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.490454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.490606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.490745] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.490837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.490914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.491417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.491578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.491721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.491857] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.944639] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-f00b45e1-972e-447a-a984-4ccb738e41f5 tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1136.946277] env[69756]: INFO networking_nsxv3.common.synchronization [req-865df714-bf85-4c75-886e-29cf3d2448c5 req-7f658852-32b0-45fb-ab38-4029b9ff0700 tempest-ServersAdminTestJSON-2109728624 tempest-ServersAdminTestJSON-2109728624-project-member] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 1136.947361] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1136.947361] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGHEST for action security_group_members [ 1136.947984] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.948148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.948448] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.949728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.949728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.949728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.949728] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.949728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.949728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.949728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.950089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.950089] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.974571] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.975229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.975321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.975642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.975720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.975935] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.976057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.976122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.976679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.976770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.976859] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed already deleted. [ 1136.976942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.977679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.977791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.977953] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.978089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.978126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.978263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.978338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.978427] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.998038] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8feed-cd04-49d0-9fbe-c89808cf758f: rpc.has_security_group_logging(os_id): False [ 1137.016170] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.016446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.016446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.016653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.016790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.017064] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.017234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.017272] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.017446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.017539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.017751] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.017835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.017901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.018157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.018207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.018384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.018486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.018556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.018699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.018774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.018859] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1137.103505] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.103757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.103867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.104135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.104663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.127595] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1137.277529] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 in Status: SUCCESS [ 1137.277783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.277960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.278236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.278422] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.278566] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.278631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.278795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.279019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.279019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.279091] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28a1544a-4fd5-4e41-87b3-73a71a6e4689',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.456197] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.456197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.456197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.456197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.456197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.456197] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.456197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.456197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.456197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.456197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.456197] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be updated. [ 1137.484089] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.484291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.484383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.484523] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.484615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.484810] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.484910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.484973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.485319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.485319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.485319] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed already deleted. [ 1137.485430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.497590] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.497750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.497819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.498093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.498323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.508973] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: IN_PROGRESS for 2s [ 1137.651989] env[69756]: INFO networking_nsxv3.common.synchronization [req-e02dec78-fe35-4ad9-8390-bf3272ff00f9 req-1fc6e2be-98de-430b-882a-202c08e0f495 tempest-InstanceActionsV221TestJSON-1853085965 tempest-InstanceActionsV221TestJSON-1853085965-project-member] Enqueued Resource ID: 70b83947-df81-4c26-945b-c5d14986de4a with Priority: HIGHEST for action security_group_members [ 1137.651989] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b83947-df81-4c26-945b-c5d14986de4a with Priority: HIGHEST for action security_group_members [ 1137.651989] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b83947-df81-4c26-945b-c5d14986de4a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.651989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.653340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.653340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.653340] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.653340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.653340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.653340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.653340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.653340] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70b83947-df81-4c26-945b-c5d14986de4a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.712471] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-3aad7585-d8ec-4a54-a5b5-6dbac20ad379 tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1137.713387] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1137.713783] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.713932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.714442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.714758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.714953] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.715078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.715144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.715374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.715502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.715642] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.781767] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a1544a-4fd5-4e41-87b3-73a71a6e4689 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.782352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.782462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.782816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.783251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.783463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.783584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.783889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.784134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.785091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.785091] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a1544a-4fd5-4e41-87b3-73a71a6e4689 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.785428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.785563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.785841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.786447] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.786642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.786821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.787104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.787257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.787454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.787568] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28a1544a-4fd5-4e41-87b3-73a71a6e4689',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.162829] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.162829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.162829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.162829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.162829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.162829] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.162829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.162829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.162829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.162829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.162829] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b83947-df81-4c26-945b-c5d14986de4a is going to be updated. [ 1138.201128] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.201475] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-232" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.201652] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-232" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.202069] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-232" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.202409] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.205021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.205021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.205021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.205021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.205021] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.205021] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.205021] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.205021] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.205021] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.205021] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.205021] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.214497] env[69756]: INFO networking_nsxv3.common.synchronization [req-bb632a1b-91a0-4aad-8360-ef4fe61a1378 req-cec12f75-7c53-4d41-b8e4-2200c18c3140 tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1138.215445] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1138.216518] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.216518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.216518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.216518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.216518] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.216518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.217193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.217193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.217193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.217193] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.219075] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.219075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.219075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.219075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.219075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.219075] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.219532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.219532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.219532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.219532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.219532] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed already deleted. [ 1138.219687] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.229793] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.229793] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1138.229793] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.229928] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-232" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.232501] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-769fddaa-a592-42db-bd06-5ca302bc3003 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.234623] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-769fddaa-a592-42db-bd06-5ca302bc3003" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.234994] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-769fddaa-a592-42db-bd06-5ca302bc3003" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.235202] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-769fddaa-a592-42db-bd06-5ca302bc3003" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.235358] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('769fddaa-a592-42db-bd06-5ca302bc3003',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.241413] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.241413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.241413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.241413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.241413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.249104] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b83947-df81-4c26-945b-c5d14986de4a in Status: IN_PROGRESS for 2s [ 1138.293072] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28a1544a-4fd5-4e41-87b3-73a71a6e4689: rpc.has_security_group_logging(os_id): False [ 1138.315702] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.315890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.315961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.316215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.316309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.316539] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.316639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.316706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.316892] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.316974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.317180] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.317276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.317337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.317468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.317543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.317728] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.317819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.317879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.318031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.318108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.318193] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 is going to be created. [ 1138.391607] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.392179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.392179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.392179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.392660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.407248] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 in Status: IN_PROGRESS for 2s [ 1138.721100] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.738116] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.738502] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.738606] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.739065] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.739266] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.739437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 769fddaa-a592-42db-bd06-5ca302bc3003 not found, creating... [ 1138.739727] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.739896] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.740088] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.740275] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.740415] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.740714] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.740876] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.741020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.741313] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.741578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.741778] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 769fddaa-a592-42db-bd06-5ca302bc3003 is going to be created. [ 1138.764504] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.764750] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.764936] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.767432] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.767727] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.768083] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-769fddaa-a592-42db-bd06-5ca302bc3003" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.146927] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1139.146927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.223496] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.444747] env[69756]: INFO networking_nsxv3.common.synchronization [req-aa428f91-c627-4d0a-afb5-5dff7758dcf9 req-f95809e1-e1fa-46a3-b575-5e3164cf977f tempest-ServerPasswordTestJSON-1047719568 tempest-ServerPasswordTestJSON-1047719568-project-member] Enqueued Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGHEST for action security_group_members [ 1139.445598] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGHEST for action security_group_members [ 1139.445895] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601c152-eb22-420e-b5ef-b628b6976a70 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.446027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.446103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.446371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.446529] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.446623] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.446684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.446827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.446912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.447032] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f601c152-eb22-420e-b5ef-b628b6976a70',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.519493] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 in Status: SUCCESS [ 1139.519663] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 deletion is rescheduled due to dependency. [ 1139.519872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.587642] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-0e4b027d-7c33-4c0b-af0e-24d09a8d133f service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1139.587842] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-0e4b027d-7c33-4c0b-af0e-24d09a8d133f service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1139.587983] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-0e4b027d-7c33-4c0b-af0e-24d09a8d133f service nova] Enqueued Resource ID: 769fddaa-a592-42db-bd06-5ca302bc3003 with Priority: HIGHEST for action port [ 1139.588285] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1139.588488] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1139.588853] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769fddaa-a592-42db-bd06-5ca302bc3003 with Priority: HIGHEST for action port [ 1139.589364] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.589518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.589604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.589865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.589949] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.593537] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.593537] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.593537] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.593537] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-769fddaa-a592-42db-bd06-5ca302bc3003 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-769fddaa-a592-42db-bd06-5ca302bc3003" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-769fddaa-a592-42db-bd06-5ca302bc3003" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.593537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-769fddaa-a592-42db-bd06-5ca302bc3003" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.593537] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('769fddaa-a592-42db-bd06-5ca302bc3003',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.727661] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.727863] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.727909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.728122] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.728217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.728320] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1139.760021] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.760021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.760021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.760021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.760021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.766988] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1139.793008] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.793265] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.793375] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.793715] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.793980] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.794189] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.794272] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.794496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.794649] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.797171] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.797171] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.797171] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.797171] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.797171] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.797171] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.797171] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.825068] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.825253] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.825396] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.825587] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.825904] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-0d3c83b5-6576-4b36-b534-1b743f8bb10a taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.826095] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-0d3c83b5-6576-4b36-b534-1b743f8bb10a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.826219] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-0d3c83b5-6576-4b36-b534-1b743f8bb10a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.826556] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-0d3c83b5-6576-4b36-b534-1b743f8bb10a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.826701] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d3c83b5-6576-4b36-b534-1b743f8bb10a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.950139] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.950341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.950509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.950820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.950927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.951217] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.951476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.951581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.951759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.951893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.952011] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f601c152-eb22-420e-b5ef-b628b6976a70 already deleted. [ 1139.952117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.095320] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.095463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.095651] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.096727] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 769fddaa-a592-42db-bd06-5ca302bc3003 with status ACTIVE [ 1140.096825] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.096901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.096940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.097161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.097249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.097418] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.097516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.097576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.097734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.097834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.098017] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.098637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.098637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.098637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.098637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.098637] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 769fddaa-a592-42db-bd06-5ca302bc3003 is going to be updated. [ 1140.122042] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.122256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.122256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.122540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.122656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.122986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-769fddaa-a592-42db-bd06-5ca302bc3003" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.263693] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b83947-df81-4c26-945b-c5d14986de4a in Status: SUCCESS [ 1140.263693] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b83947-df81-4c26-945b-c5d14986de4a deletion is rescheduled due to dependency. [ 1140.263693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b83947-df81-4c26-945b-c5d14986de4a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.328995] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.329229] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.329455] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.329774] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.329930] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.330110] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 0d3c83b5-6576-4b36-b534-1b743f8bb10a not found, creating... [ 1140.330381] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.330537] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.330651] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.330878] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.331046] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.331407] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.331594] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.331684] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.331897] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.334166] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.334450] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 0d3c83b5-6576-4b36-b534-1b743f8bb10a is going to be created. [ 1140.361285] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.361700] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.361850] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.362270] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.362650] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.362933] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-0d3c83b5-6576-4b36-b534-1b743f8bb10a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.422724] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 in Status: SUCCESS [ 1140.422724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.564119] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.564336] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-314" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.564500] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-314" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.564841] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-314" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.565313] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.565495] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.565858] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.566076] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.566233] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.566483] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.567057] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.567057] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.567057] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.567203] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.567239] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.567635] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.588569] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.588731] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1140.588881] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.589018] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-314" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.589379] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-5b51779c-2264-4614-8082-fc3166c01cb8 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.589631] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-5b51779c-2264-4614-8082-fc3166c01cb8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.589790] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-5b51779c-2264-4614-8082-fc3166c01cb8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.590164] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-5b51779c-2264-4614-8082-fc3166c01cb8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.590254] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b51779c-2264-4614-8082-fc3166c01cb8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.601023] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.092784] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.093178] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.093318] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.093863] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.093863] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.093994] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 5b51779c-2264-4614-8082-fc3166c01cb8 not found, creating... [ 1141.094249] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.094441] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.094615] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.094904] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.095068] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.095380] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.095549] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.095672] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.095893] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.096088] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.096192] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 5b51779c-2264-4614-8082-fc3166c01cb8 is going to be created. [ 1141.104202] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.104394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.104394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.104597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.104740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.105135] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be created. [ 1141.125861] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.126090] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.126806] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.127311] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.127596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.127873] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-5b51779c-2264-4614-8082-fc3166c01cb8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.135044] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.135044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.135044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.135044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.135044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.143788] env[69756]: INFO networking_nsxv3.common.synchronization [req-aa428f91-c627-4d0a-afb5-5dff7758dcf9 req-676ba555-beaa-4fbe-9586-cfd06be1d4e6 service nova] Enqueued Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGHEST for action security_group_rules [ 1141.143986] env[69756]: INFO networking_nsxv3.common.synchronization [req-aa428f91-c627-4d0a-afb5-5dff7758dcf9 req-676ba555-beaa-4fbe-9586-cfd06be1d4e6 service nova] Enqueued Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGHEST for action security_group_members [ 1141.144151] env[69756]: INFO networking_nsxv3.common.synchronization [req-aa428f91-c627-4d0a-afb5-5dff7758dcf9 req-676ba555-beaa-4fbe-9586-cfd06be1d4e6 service nova] Enqueued Resource ID: 0d3c83b5-6576-4b36-b534-1b743f8bb10a with Priority: HIGHEST for action port [ 1141.146677] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: UNINITIALIZED for 2s [ 1141.147262] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGHEST for action security_group_rules [ 1141.147438] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGHEST for action security_group_members [ 1141.147550] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d3c83b5-6576-4b36-b534-1b743f8bb10a with Priority: HIGHEST for action port [ 1141.148334] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f601c152-eb22-420e-b5ef-b628b6976a70 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.149173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.149173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.149173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.149173] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f601c152-eb22-420e-b5ef-b628b6976a70',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.149980] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601c152-eb22-420e-b5ef-b628b6976a70 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.149980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.150117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.150274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.150335] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.150415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.150472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.150616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.150685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.150780] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f601c152-eb22-420e-b5ef-b628b6976a70',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.151732] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d3c83b5-6576-4b36-b534-1b743f8bb10a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.151732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d3c83b5-6576-4b36-b534-1b743f8bb10a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.152207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d3c83b5-6576-4b36-b534-1b743f8bb10a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.152207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d3c83b5-6576-4b36-b534-1b743f8bb10a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.152207] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d3c83b5-6576-4b36-b534-1b743f8bb10a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.654404] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f601c152-eb22-420e-b5ef-b628b6976a70',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.658115] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601c152-eb22-420e-b5ef-b628b6976a70 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.658115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.658115] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d3c83b5-6576-4b36-b534-1b743f8bb10a with status ACTIVE [ 1141.658115] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.658115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.658115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.658115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.658115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.658115] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.658115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.658115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.662886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.663032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.663316] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.663443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.663599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.663717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.663797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.663915] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d3c83b5-6576-4b36-b534-1b743f8bb10a is going to be updated. [ 1141.704648] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.704648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.704648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.704648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.704648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.705461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d3c83b5-6576-4b36-b534-1b743f8bb10a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.804785] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1141.805017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.060939] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-7b54a772-c134-4ca4-9f35-dc6af621a131 service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1142.061124] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-7b54a772-c134-4ca4-9f35-dc6af621a131 service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1142.061263] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-7b54a772-c134-4ca4-9f35-dc6af621a131 service nova] Enqueued Resource ID: 5b51779c-2264-4614-8082-fc3166c01cb8 with Priority: HIGHEST for action port [ 1142.061564] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1142.061685] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1142.061776] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b51779c-2264-4614-8082-fc3166c01cb8 with Priority: HIGHEST for action port [ 1142.065187] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.065187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.065357] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.065497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.065797] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b51779c-2264-4614-8082-fc3166c01cb8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.065959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b51779c-2264-4614-8082-fc3166c01cb8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.066353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b51779c-2264-4614-8082-fc3166c01cb8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.066665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b51779c-2264-4614-8082-fc3166c01cb8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.066793] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b51779c-2264-4614-8082-fc3166c01cb8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.167563] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f601c152-eb22-420e-b5ef-b628b6976a70',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.570502] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b51779c-2264-4614-8082-fc3166c01cb8 with status ACTIVE [ 1142.570840] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.571063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.571063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.571288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.571404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.571628] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.571756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.571795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.571952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.573060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.573060] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.573060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.573060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.573060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.573060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.573060] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b51779c-2264-4614-8082-fc3166c01cb8 is going to be updated. [ 1142.597403] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.597592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.597592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.597838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.597978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.598155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b51779c-2264-4614-8082-fc3166c01cb8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.668661] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.669010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.669010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.669178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.669273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.669401] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f601c152-eb22-420e-b5ef-b628b6976a70 is going to be created. [ 1142.715463] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.715463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.715463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.715463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.715463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.723977] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f601c152-eb22-420e-b5ef-b628b6976a70 in Status: UNINITIALIZED for 2s [ 1143.086168] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.086432] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-232" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.087145] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-232" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.087145] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-232" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.087145] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.087328] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.087379] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.088122] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.088122] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.088122] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.088122] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.088122] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.088474] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.088526] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.088639] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.088774] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.110687] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.110868] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1143.111017] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.111266] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-232" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.111729] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.111920] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.113178] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.113178] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.113178] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a49f9dd-f809-412d-9f8e-f3a83b72aadb',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.156412] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1143.156659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.157484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.157484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.157604] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.157719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.157781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.157947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.158035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.158121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.158214] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.160725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.160725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.160725] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.160725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.160725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.160725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.160725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.160725] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.615454] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.615454] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.615454] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.615788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.616638] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.616830] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 5a49f9dd-f809-412d-9f8e-f3a83b72aadb not found, creating... [ 1143.617134] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.617310] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.617436] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.617696] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.617843] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.618211] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.618319] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.618438] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.618721] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.618872] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.619041] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 5a49f9dd-f809-412d-9f8e-f3a83b72aadb is going to be created. [ 1143.645659] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.646139] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.646326] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.646727] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.647144] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.647527] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.661938] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.662162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.662302] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.165331] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.451608] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-1c396bea-1112-41f2-b62a-3ea31d927e80 service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1144.451748] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-1c396bea-1112-41f2-b62a-3ea31d927e80 service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1144.451798] env[69756]: INFO networking_nsxv3.common.synchronization [req-65b27d9a-7b10-4ea9-9848-b1611bd90aca req-1c396bea-1112-41f2-b62a-3ea31d927e80 service nova] Enqueued Resource ID: 5a49f9dd-f809-412d-9f8e-f3a83b72aadb with Priority: HIGHEST for action port [ 1144.453987] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1144.454211] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1144.454340] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a49f9dd-f809-412d-9f8e-f3a83b72aadb with Priority: HIGHEST for action port [ 1144.454692] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.454812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.455061] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.455156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.455374] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.455538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.455645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.455963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.455963] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a49f9dd-f809-412d-9f8e-f3a83b72aadb',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.667657] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.667826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.667919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.668253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.668390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.668658] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1144.709052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.709308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.709308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.709555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.709741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.721276] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1144.736022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f601c152-eb22-420e-b5ef-b628b6976a70 in Status: SUCCESS [ 1144.739360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.739360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.739360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.739360] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.739360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.739360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.739360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.739360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.739360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.739360] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f601c152-eb22-420e-b5ef-b628b6976a70',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.961468] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a49f9dd-f809-412d-9f8e-f3a83b72aadb with status ACTIVE [ 1144.961696] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.961838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.961907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.962190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.962308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.962475] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.962537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.962594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.962737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.962810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.962989] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.963097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.963158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.963302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.963382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.963452] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a49f9dd-f809-412d-9f8e-f3a83b72aadb is going to be updated. [ 1144.989904] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.990058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.990058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.990543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.990753] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.990932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a49f9dd-f809-412d-9f8e-f3a83b72aadb" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.240203] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601c152-eb22-420e-b5ef-b628b6976a70 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.240569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.240569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.240665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.240823] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.240938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.241018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.241152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.241233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.241317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.241493] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601c152-eb22-420e-b5ef-b628b6976a70 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.241600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.241658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.241805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.241938] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.242033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.242091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.242223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.242297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.242391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.242475] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f601c152-eb22-420e-b5ef-b628b6976a70',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.380129] env[69756]: INFO networking_nsxv3.common.synchronization [req-ed2c4ccb-d0be-402b-a419-8233fc32e0ae req-c0e400de-72b9-4946-a674-5d082ce8a26c tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1145.380675] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1145.380980] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.381121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.381189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.381392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.382590] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.382590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.382590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.382590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.382590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.383043] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.746545] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f601c152-eb22-420e-b5ef-b628b6976a70: rpc.has_security_group_logging(os_id): False [ 1145.766385] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.766569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.766632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.766839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.766926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.767374] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.767374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.767374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.767581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.767687] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.767822] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.767918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.767972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.768152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.768223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.768425] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.768855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.768855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.768855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.768855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.768855] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f601c152-eb22-420e-b5ef-b628b6976a70 is going to be created. [ 1145.838174] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.838465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.838465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.838610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.838799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.857985] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f601c152-eb22-420e-b5ef-b628b6976a70 in Status: IN_PROGRESS for 2s [ 1145.886344] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.064893] env[69756]: INFO networking_nsxv3.common.synchronization [req-5577df91-7d0c-4de0-b8ad-d1086d99f9dc req-aff73ad4-3da9-46c0-917f-9fb27253cdbe tempest-ServerAddressesNegativeTestJSON-280619649 tempest-ServerAddressesNegativeTestJSON-280619649-project-member] Enqueued Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGHEST for action security_group_members [ 1146.065660] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGHEST for action security_group_members [ 1146.066013] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a1544a-4fd5-4e41-87b3-73a71a6e4689 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.066346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.066455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.066708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.066913] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.067228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.067331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.067547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.067806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.067958] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a1544a-4fd5-4e41-87b3-73a71a6e4689',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.389134] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.571383] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.571689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.571793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.572043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.572144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.572425] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.572582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.572666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.572855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.572959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.573134] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 is going to be updated. [ 1146.602869] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.603066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.603141] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.603383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.603484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.612955] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 in Status: IN_PROGRESS for 2s [ 1146.731674] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1146.731887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.732064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.732276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.732468] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.732586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.732660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.732816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.732894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.732975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.733152] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.733228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.733285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.733461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.733555] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.733647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.733723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.733864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.733932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.734018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.734101] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.734931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.735105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.735243] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.735334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.739132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.739317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.739409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.739523] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.891483] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.891743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.891743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.891978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.892087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.892191] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1146.926332] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.926510] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.926547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.928232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.928232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.936316] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1147.241975] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6da75da-f8d6-4e54-8043-c3718b1492ed: rpc.has_security_group_logging(os_id): False [ 1147.243713] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.269970] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.270151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.270213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.270443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.270544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.270736] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.270847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.270900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.274313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.274313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.274313] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.274313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.274313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.274313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.274313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.276241] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.276381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.276440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.276589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.276651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.276737] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be created. [ 1147.353044] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.353044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.353044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.353044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.353044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.368114] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1147.747105] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.876449] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f601c152-eb22-420e-b5ef-b628b6976a70 in Status: SUCCESS [ 1147.876695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.249767] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.249767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.249949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.250267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.250495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.250693] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1148.294931] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.295276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.295276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.295541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.296348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.308353] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1148.623441] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 in Status: SUCCESS [ 1148.623441] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 deletion is rescheduled due to dependency. [ 1148.623441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.947655] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1148.947655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.384090] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1149.384347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.384539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.384774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.384876] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.891655] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.894704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.897039] env[69756]: INFO networking_nsxv3.common.synchronization [req-c5bb0086-6f17-4786-9e3f-63e756d36815 req-3ce4b306-9820-4ef7-bbd3-ca1a24a9a0b9 tempest-ServerGroupTestJSON-88770082 tempest-ServerGroupTestJSON-88770082-project-member] Enqueued Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGHEST for action security_group_members [ 1149.898160] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGHEST for action security_group_members [ 1149.898461] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c981c7-b7d3-4add-9b02-8a36551527e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.898571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.898639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.898937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.899052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.899156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.899212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.899371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.899453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.900568] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32c981c7-b7d3-4add-9b02-8a36551527e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.318686] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1150.319011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.319108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.319318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.319538] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.319663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.319727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.319885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.319968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.320067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.320160] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.404096] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.404257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.404328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.404552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.404645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.404878] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.404984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.405060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.405225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.405294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.405385] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 already deleted. [ 1150.405466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.533068] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.533271] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-517" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.533387] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-517" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.533705] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-517" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.534419] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.534419] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.534419] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.534665] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.534665] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.534843] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.535225] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1150.535225] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1150.535225] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1150.535331] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.535430] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1150.535528] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1150.559152] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1150.559203] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1150.559537] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1150.559757] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-517" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.560142] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-afefa852-7e79-42cd-ae49-5b15d0ad8e75 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.560335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-afefa852-7e79-42cd-ae49-5b15d0ad8e75" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.560461] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-afefa852-7e79-42cd-ae49-5b15d0ad8e75" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.562204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-afefa852-7e79-42cd-ae49-5b15d0ad8e75" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.562204] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afefa852-7e79-42cd-ae49-5b15d0ad8e75',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.822569] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.822726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.822784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.823011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.823211] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.823364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.823451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.823664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.824064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.824064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.824180] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.824230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.824296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.824443] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.824647] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.824745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.824808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.824950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.825037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.825120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.825208] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.064710] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.064953] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.065106] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.065391] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.065550] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.065713] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port afefa852-7e79-42cd-ae49-5b15d0ad8e75 not found, creating... [ 1151.065982] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.066162] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.066290] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.066516] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.066661] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.066947] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.067285] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.067285] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.067480] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.068250] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.068250] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: afefa852-7e79-42cd-ae49-5b15d0ad8e75 is going to be created. [ 1151.100451] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.100700] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.100778] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.101087] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.101330] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.102372] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-afefa852-7e79-42cd-ae49-5b15d0ad8e75" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.327671] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6da75da-f8d6-4e54-8043-c3718b1492ed: rpc.has_security_group_logging(os_id): False [ 1151.346956] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.346956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.346956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.347200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.347256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.347484] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.347617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.347687] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.347931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.348066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.348304] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.348478] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.348581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.348772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.348914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.349135] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.349261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.349338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.349586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.349675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.349758] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1151.412508] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.412671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.412740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.413105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.413318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.425829] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1151.824448] env[69756]: INFO networking_nsxv3.common.synchronization [req-c5bb0086-6f17-4786-9e3f-63e756d36815 req-d541285d-a083-4dfa-bd72-61a28f073926 service nova] Enqueued Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGHEST for action security_group_rules [ 1151.824563] env[69756]: INFO networking_nsxv3.common.synchronization [req-c5bb0086-6f17-4786-9e3f-63e756d36815 req-d541285d-a083-4dfa-bd72-61a28f073926 service nova] Enqueued Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGHEST for action security_group_members [ 1151.824842] env[69756]: INFO networking_nsxv3.common.synchronization [req-c5bb0086-6f17-4786-9e3f-63e756d36815 req-d541285d-a083-4dfa-bd72-61a28f073926 service nova] Enqueued Resource ID: afefa852-7e79-42cd-ae49-5b15d0ad8e75 with Priority: HIGHEST for action port [ 1151.825297] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGHEST for action security_group_rules [ 1151.825447] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGHEST for action security_group_members [ 1151.825533] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afefa852-7e79-42cd-ae49-5b15d0ad8e75 with Priority: HIGHEST for action port [ 1151.825808] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32c981c7-b7d3-4add-9b02-8a36551527e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.825930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.825999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.826489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.826572] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32c981c7-b7d3-4add-9b02-8a36551527e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.827477] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c981c7-b7d3-4add-9b02-8a36551527e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.827625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.827695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.827951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.828213] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.828341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.828440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.828660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.828804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.828950] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32c981c7-b7d3-4add-9b02-8a36551527e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.830489] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-afefa852-7e79-42cd-ae49-5b15d0ad8e75 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.830489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afefa852-7e79-42cd-ae49-5b15d0ad8e75" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.830609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afefa852-7e79-42cd-ae49-5b15d0ad8e75" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.830668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afefa852-7e79-42cd-ae49-5b15d0ad8e75" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.830744] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afefa852-7e79-42cd-ae49-5b15d0ad8e75',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.333872] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32c981c7-b7d3-4add-9b02-8a36551527e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.334661] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c981c7-b7d3-4add-9b02-8a36551527e8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.334832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.335020] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afefa852-7e79-42cd-ae49-5b15d0ad8e75 with status ACTIVE [ 1152.335296] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.335355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.335412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.335701] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.335829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.336015] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.336519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.336591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.336770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.336852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.337073] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.337224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.337811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.338017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.338100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.338193] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afefa852-7e79-42cd-ae49-5b15d0ad8e75 is going to be updated. [ 1152.362986] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.363185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.363260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.363494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.363645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.363811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afefa852-7e79-42cd-ae49-5b15d0ad8e75" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.506024] env[69756]: INFO networking_nsxv3.common.synchronization [req-e01ce827-e7cb-4f6a-b346-b9f3925df572 req-3fad25c4-b138-408c-ad4b-39b0a4add4d2 tempest-ServerPasswordTestJSON-1047719568 tempest-ServerPasswordTestJSON-1047719568-project-member] Enqueued Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGHEST for action security_group_members [ 1152.506024] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGHEST for action security_group_members [ 1152.507130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601c152-eb22-420e-b5ef-b628b6976a70 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.510320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.510320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.510320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.510320] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.510320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.510320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.510320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.510320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.510320] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f601c152-eb22-420e-b5ef-b628b6976a70',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.842157] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32c981c7-b7d3-4add-9b02-8a36551527e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.014803] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.015173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.015252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.016073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.016244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.016617] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.016716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.016795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.017111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.017233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.017393] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f601c152-eb22-420e-b5ef-b628b6976a70 is going to be updated. [ 1153.054491] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.054491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.054729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.054729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.054964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.066280] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f601c152-eb22-420e-b5ef-b628b6976a70 in Status: IN_PROGRESS for 2s [ 1153.353355] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.353355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.353355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.353689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.353689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.353689] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 is going to be created. [ 1153.379908] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.380087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.380423] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.380423] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.380502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.394052] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 in Status: UNINITIALIZED for 2s [ 1153.441274] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1153.441950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.441950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.441950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.442133] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.944439] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.947051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.947051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.947051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.947051] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.947051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.947051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.947051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.947051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.947051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.947051] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.448914] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.449216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.449216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.449433] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.449613] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.449744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.449838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.450046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.450163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.450893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.450893] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.450893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.450893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.450893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.450893] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.451138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.451138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.451138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.451225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.451310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.453060] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.955082] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6da75da-f8d6-4e54-8043-c3718b1492ed: rpc.has_security_group_logging(os_id): False [ 1154.976375] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.976556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.976596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.976791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.976883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.977179] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.977179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.977323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.977416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.977495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.977705] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.977808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.977870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.977994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.978073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.978254] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.978347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.978403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.978541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.978615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.978702] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1155.060272] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.060552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.060647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.060890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.061098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.076357] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f601c152-eb22-420e-b5ef-b628b6976a70 in Status: SUCCESS [ 1155.076604] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f601c152-eb22-420e-b5ef-b628b6976a70 deletion is rescheduled due to dependency. [ 1155.076748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.078330] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1155.409898] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 in Status: SUCCESS [ 1155.409898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.409898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.409898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.410211] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.410275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.410316] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.410573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.410630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.410705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.410828] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32c981c7-b7d3-4add-9b02-8a36551527e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.916655] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c981c7-b7d3-4add-9b02-8a36551527e8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.916655] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.916655] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c981c7-b7d3-4add-9b02-8a36551527e8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.916655] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.916655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.917489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.917489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.917489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.917489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.917489] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32c981c7-b7d3-4add-9b02-8a36551527e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.062167] env[69756]: INFO networking_nsxv3.common.synchronization [req-8c311a14-86f0-44ec-a33d-f20402b489c5 req-8f9b466c-8539-4586-9a05-5dc2a4d98ae9 tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_members [ 1156.066246] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGHEST for action security_group_members [ 1156.066246] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.066246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.066246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.066246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.066246] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.066246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.066246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.066246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.066246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.066246] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.422024] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32c981c7-b7d3-4add-9b02-8a36551527e8: rpc.has_security_group_logging(os_id): False [ 1156.440394] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.440573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.440852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.440939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.441785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.441785] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.441785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.441785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.441785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.441785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.442078] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.442078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.442078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.442226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.442297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.448053] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.448053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.448053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.448053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.448053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.448053] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 is going to be created. [ 1156.515440] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.515440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.515440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.515440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.515440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.528662] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 in Status: IN_PROGRESS for 2s [ 1156.568739] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.571494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.572036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.572036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.573191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.574024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.574149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.574264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.574533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.574810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.574987] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 is going to be updated. [ 1156.621919] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.622332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.622332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.622715] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.622974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.637404] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 in Status: IN_PROGRESS for 2s [ 1156.978245] env[69756]: INFO networking_nsxv3.common.synchronization [req-1a5dc005-fe12-49d2-b0b6-e7804caf5e11 req-e8a02db6-0b26-4c51-aaec-f40434420df1 tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1156.978845] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1156.979227] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.979534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.979534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.979694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.980802] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.980802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.980802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.980802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.980802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.980802] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.097241] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1157.097395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.215367] env[69756]: INFO networking_nsxv3.common.synchronization [req-1a5dc005-fe12-49d2-b0b6-e7804caf5e11 req-31da9223-2882-4f0a-b6d8-3fc43e2dcbb1 tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1157.216143] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1157.218654] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.218654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.483146] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.665344] env[69756]: INFO networking_nsxv3.common.synchronization [req-1a5dc005-fe12-49d2-b0b6-e7804caf5e11 req-25596480-c32e-48e2-a4f0-03f2f59f21c4 tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1157.665888] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1157.666243] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.666352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.986603] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.494970] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.494970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.494970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.494970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.494970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.494970] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1158.523245] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.526368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.526368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.526607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.526803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.538504] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1158.540641] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 in Status: SUCCESS [ 1158.540800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.647423] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 in Status: SUCCESS [ 1158.647590] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 deletion is rescheduled due to dependency. [ 1158.647693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.717391] env[69756]: INFO networking_nsxv3.common.synchronization [req-89ed0993-1519-416b-ba63-8b06484b4e3e req-8a5909e0-611b-4b08-9bf3-e0e10b369eba tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_members [ 1158.718042] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_members [ 1158.718307] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.719271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.719271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.719271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.719271] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.719271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.719271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.719271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.719271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.719599] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.053463] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.053463] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.053463] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.053463] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.053463] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.054240] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.054240] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.054240] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.054240] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.054436] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1159.054506] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.054625] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.054738] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.054855] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1159.054965] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.055124] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.079902] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.079902] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1159.079902] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.079902] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.079902] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-0a76094a-30d4-4826-b815-d9a352e1aa4b taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.079902] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-0a76094a-30d4-4826-b815-d9a352e1aa4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.079902] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-0a76094a-30d4-4826-b815-d9a352e1aa4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.079902] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-0a76094a-30d4-4826-b815-d9a352e1aa4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.079902] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a76094a-30d4-4826-b815-d9a352e1aa4b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.221916] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.221916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.221916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.222219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.222304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.222504] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.222623] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.222664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.222865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.222953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.223076] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 already deleted. [ 1159.223172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.581989] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.582336] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.582511] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.582892] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.583071] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.583242] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 0a76094a-30d4-4826-b815-d9a352e1aa4b not found, creating... [ 1159.583590] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.583760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.583885] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.584146] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.584338] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.584736] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.585046] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.585212] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.585563] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.585874] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.586130] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 0a76094a-30d4-4826-b815-d9a352e1aa4b is going to be created. [ 1159.612668] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.612956] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.613142] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.613437] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.613673] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.613913] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-0a76094a-30d4-4826-b815-d9a352e1aa4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.456106] env[69756]: INFO networking_nsxv3.common.synchronization [req-89ed0993-1519-416b-ba63-8b06484b4e3e req-06105083-1938-4020-bee4-f4ae3cf60ab3 service nova] Enqueued Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_rules [ 1160.456427] env[69756]: INFO networking_nsxv3.common.synchronization [req-89ed0993-1519-416b-ba63-8b06484b4e3e req-06105083-1938-4020-bee4-f4ae3cf60ab3 service nova] Enqueued Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_members [ 1160.456566] env[69756]: INFO networking_nsxv3.common.synchronization [req-89ed0993-1519-416b-ba63-8b06484b4e3e req-06105083-1938-4020-bee4-f4ae3cf60ab3 service nova] Enqueued Resource ID: 0a76094a-30d4-4826-b815-d9a352e1aa4b with Priority: HIGHEST for action port [ 1160.457158] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_rules [ 1160.457305] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_members [ 1160.457404] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a76094a-30d4-4826-b815-d9a352e1aa4b with Priority: HIGHEST for action port [ 1160.457688] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.457813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.457889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.458103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.458184] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.459435] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.459559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.459627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.459870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.460033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.460143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.460210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.460357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.460432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.460527] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.465038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a76094a-30d4-4826-b815-d9a352e1aa4b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.465038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a76094a-30d4-4826-b815-d9a352e1aa4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.465038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a76094a-30d4-4826-b815-d9a352e1aa4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.465038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a76094a-30d4-4826-b815-d9a352e1aa4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.465038] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a76094a-30d4-4826-b815-d9a352e1aa4b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.553552] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1160.553552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.553760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.554747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.554747] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.554747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.554747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.555011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.555098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.555311] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.964280] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.965319] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.965444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.965772] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a76094a-30d4-4826-b815-d9a352e1aa4b with status ACTIVE [ 1160.965922] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.966040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.966103] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.966303] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.966386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.966547] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.966634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.966693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.966831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.966903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.967092] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.967180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.967239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.967374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.967530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.967530] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a76094a-30d4-4826-b815-d9a352e1aa4b is going to be updated. [ 1160.989814] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.990023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.990107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.991041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.991041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.991041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a76094a-30d4-4826-b815-d9a352e1aa4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.057989] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.058176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.058246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.058470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.058563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.058776] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.058980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.058980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.059119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.059179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.059265] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1161.093792] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.094124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.094124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.094417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.094470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.115420] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1161.467120] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.969823] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.970117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.970267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.970642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.970885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.971036] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 is going to be created. [ 1161.998745] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.998883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.998989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.999210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.999344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.011035] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 in Status: UNINITIALIZED for 2s [ 1163.129046] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1163.129403] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed deletion is rescheduled due to dependency. [ 1163.129403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.130255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.130255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.130255] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.130652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.131017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.131235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.133074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.133074] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.153399] env[69756]: INFO networking_nsxv3.common.synchronization [req-269b35b9-9eef-4f8b-b0d4-32e345366676 req-7b22130a-085c-4431-954c-f060b93e3197 tempest-ServersNegativeTestJSON-1110560868 tempest-ServersNegativeTestJSON-1110560868-project-member] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 1163.153983] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGHEST for action security_group_members [ 1163.154521] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.156213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.156213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.156213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.156213] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.156213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.156213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.156213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.156213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.156213] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.636967] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.637155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.637221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.637524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.637625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.637829] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.637980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.638063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.638815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.638815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.640111] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1163.658983] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.659338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.659338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.659338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.659511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.659608] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.659878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.659878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.660342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.660342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.660342] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be updated. [ 1163.665112] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.665311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.665311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.666378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.666378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.677900] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1163.695072] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.695280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.695280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.695476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.695608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.707152] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: IN_PROGRESS for 2s [ 1164.030398] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 in Status: SUCCESS [ 1164.030649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.030897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.031437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.031437] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.031709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.031709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.031909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.031969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.032525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.032675] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.535500] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.041245] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3abf8d34-b1bf-4948-b5ca-6ddaf615a162: rpc.has_security_group_logging(os_id): False [ 1165.059290] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.060136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.060136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.060136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.060136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.061698] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.061698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.061698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.061698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.061698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.061698] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 is going to be created. [ 1165.131780] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.131780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.131780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.131780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.131780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.142641] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 in Status: IN_PROGRESS for 2s [ 1165.690160] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1165.690160] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed deletion is rescheduled due to dependency. [ 1165.690160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.718297] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 285c5000-ac60-42b0-8441-f857f98438d0 in Status: SUCCESS [ 1165.718297] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 deletion is rescheduled due to dependency. [ 1165.718297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.189284] env[69756]: INFO networking_nsxv3.common.synchronization [None req-66efcd15-a92b-4b24-9a47-c2a54d13444c tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 85574f20-b293-4297-9563-d46f6b2b0924 with Priority: HIGHEST for action security_group_rules [ 1166.189802] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85574f20-b293-4297-9563-d46f6b2b0924 with Priority: HIGHEST for action security_group_rules [ 1166.194748] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85574f20-b293-4297-9563-d46f6b2b0924 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.194929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85574f20-b293-4297-9563-d46f6b2b0924" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.194992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85574f20-b293-4297-9563-d46f6b2b0924" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.195508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85574f20-b293-4297-9563-d46f6b2b0924" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.195643] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85574f20-b293-4297-9563-d46f6b2b0924',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.356979] env[69756]: INFO networking_nsxv3.common.synchronization [None req-bb309f9f-6809-45f5-806b-4c2c36d03886 tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 85574f20-b293-4297-9563-d46f6b2b0924 with Priority: HIGHEST for action security_group_rules [ 1166.356979] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85574f20-b293-4297-9563-d46f6b2b0924 with Priority: HIGHEST for action security_group_rules [ 1166.357238] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85574f20-b293-4297-9563-d46f6b2b0924 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.357405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85574f20-b293-4297-9563-d46f6b2b0924" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.721665] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.721665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.721665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.721665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.724042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.724042] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85574f20-b293-4297-9563-d46f6b2b0924 already deleted. [ 1166.724042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85574f20-b293-4297-9563-d46f6b2b0924" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.724042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85574f20-b293-4297-9563-d46f6b2b0924" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.724042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85574f20-b293-4297-9563-d46f6b2b0924" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.724042] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85574f20-b293-4297-9563-d46f6b2b0924',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.920080] env[69756]: INFO networking_nsxv3.common.synchronization [req-ce43c9d7-c185-485b-9a8b-3e9035b211a2 req-4d00f1b4-f220-4a15-9fc1-5e9208779c71 tempest-ServersV294TestFqdnHostnames-406915398 tempest-ServersV294TestFqdnHostnames-406915398-project-member] Enqueued Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_members [ 1166.920916] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGHEST for action security_group_members [ 1166.921031] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7abf7f6-a856-4157-be54-ef99b007674f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.921123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.921170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.921360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.921560] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.921617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.921658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.921778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.921904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.921982] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.157102] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 in Status: SUCCESS [ 1167.157343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.248690] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.248690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.248690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.248690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.248690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.248690] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85574f20-b293-4297-9563-d46f6b2b0924 already deleted. [ 1167.248690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85574f20-b293-4297-9563-d46f6b2b0924" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.428844] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.428844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.428844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.428844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.428844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.428844] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.428844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.428844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.428844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.428844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.428844] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7abf7f6-a856-4157-be54-ef99b007674f is going to be updated. [ 1167.457550] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.457729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.457800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.458025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.460616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.471784] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7abf7f6-a856-4157-be54-ef99b007674f in Status: IN_PROGRESS for 2s [ 1167.905091] env[69756]: INFO networking_nsxv3.common.synchronization [req-ec3fe638-7923-4cd7-b5bf-90771816f08d req-bb0509ba-c6bc-4545-affc-9dd69aed17cf tempest-ServerGroupTestJSON-88770082 tempest-ServerGroupTestJSON-88770082-project-member] Enqueued Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGHEST for action security_group_members [ 1167.907460] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGHEST for action security_group_members [ 1167.907460] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c981c7-b7d3-4add-9b02-8a36551527e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.907460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.907460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.907460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.907980] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.907980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.907980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.907980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.908270] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.909520] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32c981c7-b7d3-4add-9b02-8a36551527e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.411225] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.411394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.411466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.411709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.412199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.412439] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.412559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.412626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.412777] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.412862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.412956] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 is going to be updated. [ 1168.440501] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.441262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.441262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.441462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.441603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.450452] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 in Status: IN_PROGRESS for 2s [ 1169.485451] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7abf7f6-a856-4157-be54-ef99b007674f in Status: SUCCESS [ 1169.485451] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7abf7f6-a856-4157-be54-ef99b007674f deletion is rescheduled due to dependency. [ 1169.485451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.738658] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8142d247-f1ca-4b5e-9895-5101f310134e None None] Enqueued Resource ID: e03756b2-5e42-4a89-af1a-48843d5227d5 with Priority: HIGHEST for action port [ 1169.739766] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03756b2-5e42-4a89-af1a-48843d5227d5 with Priority: HIGHEST for action port [ 1169.740445] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-e03756b2-5e42-4a89-af1a-48843d5227d5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.740570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e03756b2-5e42-4a89-af1a-48843d5227d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.740664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e03756b2-5e42-4a89-af1a-48843d5227d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.741105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e03756b2-5e42-4a89-af1a-48843d5227d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.741105] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e03756b2-5e42-4a89-af1a-48843d5227d5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.773636] env[69756]: INFO networking_nsxv3.common.synchronization [None req-dcf1386f-c8c9-443b-a735-a7614de60ed3 None None] Enqueued Resource ID: 6c5b110b-3077-4e11-8cdb-a554469f08de with Priority: HIGHEST for action port [ 1169.775200] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c5b110b-3077-4e11-8cdb-a554469f08de with Priority: HIGHEST for action port [ 1169.775200] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c5b110b-3077-4e11-8cdb-a554469f08de taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.775200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c5b110b-3077-4e11-8cdb-a554469f08de" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.775200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c5b110b-3077-4e11-8cdb-a554469f08de" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.775200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c5b110b-3077-4e11-8cdb-a554469f08de" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.775200] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c5b110b-3077-4e11-8cdb-a554469f08de',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.244652] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e03756b2-5e42-4a89-af1a-48843d5227d5 [ 1170.244652] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.244652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.244652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.244652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.244652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.244652] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e03756b2-5e42-4a89-af1a-48843d5227d5 already deleted. [ 1170.244652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e03756b2-5e42-4a89-af1a-48843d5227d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.277048] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c5b110b-3077-4e11-8cdb-a554469f08de [ 1170.277252] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.277456] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.277531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.277756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.277848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.277952] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c5b110b-3077-4e11-8cdb-a554469f08de already deleted. [ 1170.278068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c5b110b-3077-4e11-8cdb-a554469f08de" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.462876] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 in Status: SUCCESS [ 1170.463179] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 deletion is rescheduled due to dependency. [ 1170.463376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.777486] env[69756]: INFO networking_nsxv3.common.synchronization [req-3dc30b68-0263-48f4-a4ac-ab512901ac0e req-b250f07e-9a0a-4115-a0fa-76a59d94757f tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1171.778073] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1171.778324] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.778444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.778512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.778711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.778868] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.778967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.779040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.779188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.779270] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.779362] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.196346] env[69756]: INFO networking_nsxv3.common.synchronization [req-0dc34de5-217d-4a29-86f2-0938e93bb230 req-e6ffab8c-0324-4b63-a80e-9099897dce35 tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1172.200023] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1172.200023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.200023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.200023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.200023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.200023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.200023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.200023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.200023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.200023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.200023] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.235514] env[69756]: INFO networking_nsxv3.common.synchronization [req-0afd0fe5-a8ab-4770-8285-b47027f467e0 req-98541354-6e69-452c-b4c6-f295c7598c42 tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1172.236315] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1172.236686] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.236814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.236890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.237196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.237425] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.237568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.237829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.237894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.238911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.238911] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.281785] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.281951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.282918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.282918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.282918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.282918] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.282918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.282918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.282918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.282918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.283299] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1172.352222] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.352222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.352222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.352222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.352222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.363594] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1172.434963] env[69756]: INFO networking_nsxv3.common.synchronization [None req-3b4129b4-0e97-434e-ad5e-4b7f6175468e None None] Enqueued Resource ID: bf927677-e8d2-4d74-bb4b-3b97dde4eed2 with Priority: HIGHEST for action port [ 1172.435221] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf927677-e8d2-4d74-bb4b-3b97dde4eed2 with Priority: HIGHEST for action port [ 1172.435771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf927677-e8d2-4d74-bb4b-3b97dde4eed2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.435894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf927677-e8d2-4d74-bb4b-3b97dde4eed2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.435960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf927677-e8d2-4d74-bb4b-3b97dde4eed2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.436233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf927677-e8d2-4d74-bb4b-3b97dde4eed2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.436312] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf927677-e8d2-4d74-bb4b-3b97dde4eed2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.700547] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.740378] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.740524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.741110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.741110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.741110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.741110] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.741295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.741295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.741520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.741651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.741792] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1172.773585] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.773730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.773794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.774057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.774205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.784522] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1172.938047] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf927677-e8d2-4d74-bb4b-3b97dde4eed2 [ 1172.940284] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.940284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.940284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.940284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.940284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.940284] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf927677-e8d2-4d74-bb4b-3b97dde4eed2 already deleted. [ 1172.940284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf927677-e8d2-4d74-bb4b-3b97dde4eed2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.009546] env[69756]: INFO networking_nsxv3.common.synchronization [None req-dd5f7cfa-572d-4de3-b05b-7b823fec90e6 None None] Enqueued Resource ID: 921096f7-5cc1-4ff7-bc7e-305f2cfe8888 with Priority: HIGHEST for action port [ 1173.009546] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 921096f7-5cc1-4ff7-bc7e-305f2cfe8888 with Priority: HIGHEST for action port [ 1173.009546] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-921096f7-5cc1-4ff7-bc7e-305f2cfe8888 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.010582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-921096f7-5cc1-4ff7-bc7e-305f2cfe8888" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.010582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-921096f7-5cc1-4ff7-bc7e-305f2cfe8888" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.010582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-921096f7-5cc1-4ff7-bc7e-305f2cfe8888" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.010582] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('921096f7-5cc1-4ff7-bc7e-305f2cfe8888',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.203588] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.514819] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 921096f7-5cc1-4ff7-bc7e-305f2cfe8888 [ 1173.514819] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.514819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.514819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.514819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.514819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.514819] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:921096f7-5cc1-4ff7-bc7e-305f2cfe8888 already deleted. [ 1173.514819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-921096f7-5cc1-4ff7-bc7e-305f2cfe8888" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.708595] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.708595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.708757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.709544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.709544] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.709544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1173.743662] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.743919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.743992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.744306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.744516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.750714] env[69756]: INFO networking_nsxv3.common.synchronization [None req-f537658e-dd8f-4bf6-b854-c6bb0f618b2d None None] Enqueued Resource ID: 67193c80-0c4a-408b-b6c5-bcc47064e616 with Priority: HIGHEST for action port [ 1173.751815] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67193c80-0c4a-408b-b6c5-bcc47064e616 with Priority: HIGHEST for action port [ 1173.751815] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-67193c80-0c4a-408b-b6c5-bcc47064e616 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.752131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67193c80-0c4a-408b-b6c5-bcc47064e616" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.752246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67193c80-0c4a-408b-b6c5-bcc47064e616" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.752547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67193c80-0c4a-408b-b6c5-bcc47064e616" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.752673] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67193c80-0c4a-408b-b6c5-bcc47064e616',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.761786] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1174.261502] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67193c80-0c4a-408b-b6c5-bcc47064e616 [ 1174.261851] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.262081] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.262186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.262498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.262683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.262850] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67193c80-0c4a-408b-b6c5-bcc47064e616 already deleted. [ 1174.262983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67193c80-0c4a-408b-b6c5-bcc47064e616" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.375159] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1174.375159] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 deletion is rescheduled due to dependency. [ 1174.375159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.425062] env[69756]: INFO networking_nsxv3.common.synchronization [None req-aa01da93-58dc-4155-aceb-ff18ccc6108a tempest-VolumesAdminNegativeTest-1357987219 tempest-VolumesAdminNegativeTest-1357987219-project-member] Enqueued Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_rules [ 1174.425946] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_rules [ 1174.426275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76720d0-5804-46fa-8a2f-21842f720546 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.426424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.426513] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.426722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.426787] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.619287] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8751c8ae-0054-4d93-965a-7f31332e3649 tempest-VolumesAdminNegativeTest-1357987219 tempest-VolumesAdminNegativeTest-1357987219-project-member] Enqueued Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_rules [ 1174.619967] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_rules [ 1174.620323] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76720d0-5804-46fa-8a2f-21842f720546 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.620440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.797047] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1174.797333] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a deletion is rescheduled due to dependency. [ 1174.797548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.954772] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.954772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.954772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.954772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.954772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.954772] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76720d0-5804-46fa-8a2f-21842f720546 already deleted. [ 1174.954772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.954772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.954772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.954772] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.258706] env[69756]: INFO networking_nsxv3.common.synchronization [req-9b00cb72-031d-461f-98d3-524312f32b68 req-ba8ffc73-a868-4f1e-be33-e8b7c74800a5 tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1175.264835] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1175.268097] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.268097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.268097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.268097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.268097] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.269872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.269872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.269872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.269872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.269872] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.482562] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.482562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.482562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.482562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.483679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.483786] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76720d0-5804-46fa-8a2f-21842f720546 already deleted. [ 1175.483869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.773106] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1175.773656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.773759] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.773899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.773966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.774230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.774299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.774498] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.774601] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.774674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.774829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.774906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.774991] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1175.805210] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.805409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.805409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.805632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.805780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.815962] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1176.483882] env[69756]: INFO networking_nsxv3.common.synchronization [None req-1ba64376-a7e2-4956-8c88-743bfda3426b None None] Enqueued Resource ID: f27f5764-fef3-48e9-af75-951c02bbff60 with Priority: HIGHEST for action port [ 1176.484455] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f27f5764-fef3-48e9-af75-951c02bbff60 with Priority: HIGHEST for action port [ 1176.484781] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f27f5764-fef3-48e9-af75-951c02bbff60 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.484919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f27f5764-fef3-48e9-af75-951c02bbff60" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.484991] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f27f5764-fef3-48e9-af75-951c02bbff60" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.485488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f27f5764-fef3-48e9-af75-951c02bbff60" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.485616] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f27f5764-fef3-48e9-af75-951c02bbff60',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.989866] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f27f5764-fef3-48e9-af75-951c02bbff60 [ 1176.991104] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.991104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.991104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.991104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.991104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.991104] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f27f5764-fef3-48e9-af75-951c02bbff60 already deleted. [ 1176.991104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f27f5764-fef3-48e9-af75-951c02bbff60" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.828266] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1177.828561] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 1177.828561] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.487072] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1181.487072] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1186.023318] env[69756]: INFO networking_nsxv3.common.synchronization [req-6be56da1-d556-48b6-927b-fb76f8d8c205 req-b37ac8f5-0245-4f15-80fd-724ad4317cd2 tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_members [ 1186.023952] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5f631a6-10e1-4423-9d64-92e1be795a21 with Priority: HIGHEST for action security_group_members [ 1186.024324] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5f631a6-10e1-4423-9d64-92e1be795a21 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.024456] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.024523] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.024726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.024878] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.025383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.025487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.025624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.025715] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.025816] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5f631a6-10e1-4423-9d64-92e1be795a21',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.529651] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.529813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.529876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.530175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.551510] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.551781] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.551926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.552011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.552207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.552295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.552386] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5f631a6-10e1-4423-9d64-92e1be795a21 is going to be updated. [ 1186.582425] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.582567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.582639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.582858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.584269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.592500] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5f631a6-10e1-4423-9d64-92e1be795a21 in Status: IN_PROGRESS for 2s [ 1188.607904] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5f631a6-10e1-4423-9d64-92e1be795a21 in Status: SUCCESS [ 1188.608290] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5f631a6-10e1-4423-9d64-92e1be795a21 deletion is rescheduled due to dependency. [ 1188.608290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5f631a6-10e1-4423-9d64-92e1be795a21" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.677338] env[69756]: INFO networking_nsxv3.common.synchronization [None req-f537d0f6-c4ed-4a0d-a564-ecbd4cd443f1 tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_rules [ 1189.677338] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_rules [ 1189.677338] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.677338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.677338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.677338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.677338] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.755621] env[69756]: INFO networking_nsxv3.common.synchronization [None req-affb2e7d-50a1-4da6-90ae-79cc20a70ca8 tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_rules [ 1189.755807] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_rules [ 1189.756557] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.756557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.200784] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.200784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.200784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.200784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.200784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.200784] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 already deleted. [ 1190.200784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.200784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.200784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.200784] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.720716] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.720971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.720971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.721208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.721290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.721399] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 already deleted. [ 1190.721467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.756769] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1194.757153] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1195.474978] env[69756]: INFO networking_nsxv3.common.synchronization [req-c557abbf-20e5-41cf-b38c-0f8d6e2ad4f7 req-6b3d484f-b674-4dce-8cfc-2599c6cc816d tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1195.475514] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1195.475812] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.475935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.476015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.476631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.476805] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.476914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.476976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.477160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.477526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.477627] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.792281] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.792865] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.792865] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.792965] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.793666] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.793876] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.793994] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.794543] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.794731] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.794944] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.795296] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.795539] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.795609] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.795694] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.795937] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.795937] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.817808] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.817912] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1195.818048] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.818233] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.818574] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-07525ce2-4e28-40a9-82f7-cf0bddbc3876 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.818866] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-07525ce2-4e28-40a9-82f7-cf0bddbc3876" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.818866] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-07525ce2-4e28-40a9-82f7-cf0bddbc3876" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.819232] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-07525ce2-4e28-40a9-82f7-cf0bddbc3876" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.819380] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07525ce2-4e28-40a9-82f7-cf0bddbc3876',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.980821] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.981017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.981124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.981369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.981464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.981719] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.981847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.982046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.982299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.982408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.982520] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1196.010083] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.010322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.010422] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.010581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.010750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.024315] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1196.326687] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.326954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.327085] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.327426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.327589] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.327753] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 07525ce2-4e28-40a9-82f7-cf0bddbc3876 not found, creating... [ 1196.328030] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.328200] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.328323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.328625] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.328725] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.329021] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.329335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.329335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.329459] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.329592] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.329731] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 07525ce2-4e28-40a9-82f7-cf0bddbc3876 is going to be created. [ 1196.345030] env[69756]: INFO networking_nsxv3.common.synchronization [None req-df6c48a7-6c0a-419a-adc7-3d134bb3b6c0 None None] Enqueued Resource ID: 16c00f36-1464-4e5a-8b90-fc8dabe2900c with Priority: HIGHEST for action port [ 1196.345180] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c00f36-1464-4e5a-8b90-fc8dabe2900c with Priority: HIGHEST for action port [ 1196.345825] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-16c00f36-1464-4e5a-8b90-fc8dabe2900c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.345825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16c00f36-1464-4e5a-8b90-fc8dabe2900c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.345999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16c00f36-1464-4e5a-8b90-fc8dabe2900c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.346157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16c00f36-1464-4e5a-8b90-fc8dabe2900c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.346246] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16c00f36-1464-4e5a-8b90-fc8dabe2900c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.349575] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.349575] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.349575] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.349830] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.350250] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.350484] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-07525ce2-4e28-40a9-82f7-cf0bddbc3876" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.850815] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16c00f36-1464-4e5a-8b90-fc8dabe2900c [ 1196.850815] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.850815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.850815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.850815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.850815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.850815] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16c00f36-1464-4e5a-8b90-fc8dabe2900c already deleted. [ 1196.850815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16c00f36-1464-4e5a-8b90-fc8dabe2900c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.134397] env[69756]: INFO networking_nsxv3.common.synchronization [req-c557abbf-20e5-41cf-b38c-0f8d6e2ad4f7 req-60020dc2-781c-423d-8cd0-114edb72cd0a service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 1197.134598] env[69756]: INFO networking_nsxv3.common.synchronization [req-c557abbf-20e5-41cf-b38c-0f8d6e2ad4f7 req-60020dc2-781c-423d-8cd0-114edb72cd0a service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1197.134747] env[69756]: INFO networking_nsxv3.common.synchronization [req-c557abbf-20e5-41cf-b38c-0f8d6e2ad4f7 req-60020dc2-781c-423d-8cd0-114edb72cd0a service nova] Enqueued Resource ID: 07525ce2-4e28-40a9-82f7-cf0bddbc3876 with Priority: HIGHEST for action port [ 1197.134992] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 1197.135132] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1197.135229] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07525ce2-4e28-40a9-82f7-cf0bddbc3876 with Priority: HIGHEST for action port [ 1197.135847] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.135944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.135983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.137958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.137958] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.138750] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.138998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.139328] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-07525ce2-4e28-40a9-82f7-cf0bddbc3876 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.142583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07525ce2-4e28-40a9-82f7-cf0bddbc3876" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.142583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07525ce2-4e28-40a9-82f7-cf0bddbc3876" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.142583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07525ce2-4e28-40a9-82f7-cf0bddbc3876" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.142583] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07525ce2-4e28-40a9-82f7-cf0bddbc3876',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.495957] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1197.496410] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1197.643024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.643305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.643472] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07525ce2-4e28-40a9-82f7-cf0bddbc3876 with status ACTIVE [ 1197.643650] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.643757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.643825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.644051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.644146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.644324] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.644415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.644477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.644633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.644712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.644886] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.644980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.645060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.645204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.645296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.645361] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07525ce2-4e28-40a9-82f7-cf0bddbc3876 is going to be updated. [ 1197.670588] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.670737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.670790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.671158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.671158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.671295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07525ce2-4e28-40a9-82f7-cf0bddbc3876" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.035124] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1198.035558] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 deletion is rescheduled due to dependency. [ 1198.035558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.035635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.035809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.035995] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.036145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.036219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.036394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.036469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.036564] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.319951] env[69756]: INFO networking_nsxv3.common.synchronization [req-0dbb79dc-d871-4770-997f-30440ba6d5ee req-b8badd45-38f1-4a68-9fe6-f8bde4795f11 tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1198.320555] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1198.320871] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.321567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.321670] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.321877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.322090] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.322203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.322280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.322447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.322547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.322912] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.539200] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.631646] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.631848] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.632040] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.632316] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.632894] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.633192] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.633341] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.633569] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.633722] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.633934] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.634066] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.634186] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.634318] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.634448] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.634561] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.634698] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.653414] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.653602] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1198.653729] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.653905] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-770" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.654237] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-2e89ff90-52be-443e-8374-7b1767570410 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.654442] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-2e89ff90-52be-443e-8374-7b1767570410" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.654568] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-2e89ff90-52be-443e-8374-7b1767570410" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.654924] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-2e89ff90-52be-443e-8374-7b1767570410" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.655085] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e89ff90-52be-443e-8374-7b1767570410',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.774933] env[69756]: INFO networking_nsxv3.common.synchronization [None req-71a0f43c-3ca6-4411-a135-a484c37ec16b None None] Enqueued Resource ID: c56a3263-6781-46ef-9988-d1867326a607 with Priority: HIGHEST for action port [ 1198.775237] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c56a3263-6781-46ef-9988-d1867326a607 with Priority: HIGHEST for action port [ 1198.775786] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c56a3263-6781-46ef-9988-d1867326a607 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.775935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c56a3263-6781-46ef-9988-d1867326a607" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.775975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c56a3263-6781-46ef-9988-d1867326a607" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.777507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c56a3263-6781-46ef-9988-d1867326a607" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.777507] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c56a3263-6781-46ef-9988-d1867326a607',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.824487] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.824674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.824744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.824919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.825040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.825234] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.825328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.825382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.825538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.825614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.825698] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1198.852985] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.853865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.853865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.853865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.853865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.863413] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1199.042661] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.159433] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.161280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.161280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.161280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.161280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.161280] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 2e89ff90-52be-443e-8374-7b1767570410 not found, creating... [ 1199.161280] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.161280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.161280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.161611] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.161611] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.161793] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.161909] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.162203] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.162443] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.162582] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.162772] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 2e89ff90-52be-443e-8374-7b1767570410 is going to be created. [ 1199.188527] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.188845] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.189031] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.189459] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.189757] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.191239] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-2e89ff90-52be-443e-8374-7b1767570410" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.278960] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c56a3263-6781-46ef-9988-d1867326a607 [ 1199.278960] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.279131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.279131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.279636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.279636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.279636] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c56a3263-6781-46ef-9988-d1867326a607 already deleted. [ 1199.280855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c56a3263-6781-46ef-9988-d1867326a607" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.544860] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.545029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.545093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.545306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.545459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.545502] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1199.573867] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.574010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.574090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.574457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.574647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.584999] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1199.888316] env[69756]: INFO networking_nsxv3.common.synchronization [req-0dbb79dc-d871-4770-997f-30440ba6d5ee req-ee50534a-4069-442e-a0da-0ebeb6bdd0c9 service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 1199.888544] env[69756]: INFO networking_nsxv3.common.synchronization [req-0dbb79dc-d871-4770-997f-30440ba6d5ee req-ee50534a-4069-442e-a0da-0ebeb6bdd0c9 service nova] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1199.888665] env[69756]: INFO networking_nsxv3.common.synchronization [req-0dbb79dc-d871-4770-997f-30440ba6d5ee req-ee50534a-4069-442e-a0da-0ebeb6bdd0c9 service nova] Enqueued Resource ID: 2e89ff90-52be-443e-8374-7b1767570410 with Priority: HIGHEST for action port [ 1199.888878] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_rules [ 1199.889014] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1199.889125] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e89ff90-52be-443e-8374-7b1767570410 with Priority: HIGHEST for action port [ 1199.889668] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.889931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.889931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.894758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.894758] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.894758] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.894758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.894758] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e89ff90-52be-443e-8374-7b1767570410 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.894758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e89ff90-52be-443e-8374-7b1767570410" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.894758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e89ff90-52be-443e-8374-7b1767570410" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.894758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e89ff90-52be-443e-8374-7b1767570410" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.894758] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e89ff90-52be-443e-8374-7b1767570410',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.396183] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.396183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.396183] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e89ff90-52be-443e-8374-7b1767570410 with status ACTIVE [ 1200.396525] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.396525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.396525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.396677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.396718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.396871] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.396970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.397053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.397211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.397298] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.397537] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.397653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.397703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.397834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.397900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.397989] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e89ff90-52be-443e-8374-7b1767570410 is going to be updated. [ 1200.422206] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.422390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.422431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.422633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.422768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.422979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e89ff90-52be-443e-8374-7b1767570410" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.873559] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1200.873792] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a deletion is rescheduled due to dependency. [ 1200.873874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.874081] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.874361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.874604] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.874732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.874799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.874957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.875069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.875229] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.377505] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.596499] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1201.596928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.596928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.597849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.597849] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.597849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.597849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.597849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.598191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.598419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.598507] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.880471] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.100879] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.100879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.100879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.101114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.101293] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.101458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.101508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.101648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.101736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.101828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.102053] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.103586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.103586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.103586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.103586] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.103586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.103586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.103586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.103586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.103586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.103586] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.382614] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.382793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.382835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.383068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.383164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.383267] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1202.415051] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.415212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.415288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.415505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.415649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.423436] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1202.488600] env[69756]: INFO networking_nsxv3.common.synchronization [req-a30bed13-d14e-421d-8bfd-cef4fe7fd519 req-a8530787-8ac5-4d0e-bcdf-e55a91f34236 tempest-ServerRescueTestJSON-402335687 tempest-ServerRescueTestJSON-402335687-project-member] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1202.488600] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1202.488600] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.488600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.488600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.488600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.488600] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.488600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.488600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.488600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.488600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.488600] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.606068] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8: rpc.has_security_group_logging(os_id): False [ 1202.624208] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.624405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.624405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.624600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.624697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.624901] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.625013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.625092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.625447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.625531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.625738] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.626254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.626254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.626662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.626789] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.627036] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.627204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.627305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.627685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.627814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.627928] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1202.689845] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.689974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.690193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.690438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.690591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.706105] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1202.799537] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.799730] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-755" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.799877] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-755" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.800340] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-755" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.800653] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.800821] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.800942] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.801192] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.801343] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.801559] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.801677] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1202.801791] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1202.801904] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1202.802106] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.802228] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1202.802369] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1202.824314] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1202.824497] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1202.824642] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1202.824827] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-755" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.825227] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-1867a1f0-711a-441e-8513-0621401e152c taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.825422] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-1867a1f0-711a-441e-8513-0621401e152c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.825553] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-1867a1f0-711a-441e-8513-0621401e152c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.825880] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-1867a1f0-711a-441e-8513-0621401e152c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.826044] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1867a1f0-711a-441e-8513-0621401e152c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.990759] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.992466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.992466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.992466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.992466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.992466] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.992466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.992466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.992466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.992466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.992466] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e14423-20f6-4632-a776-83c92acbd98e already deleted. [ 1202.992466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.330686] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.330686] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.330686] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.330686] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.330686] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.330686] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 1867a1f0-711a-441e-8513-0621401e152c not found, creating... [ 1203.330686] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.331250] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.331250] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.331250] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.331406] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.331701] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.331881] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.332086] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.332366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.332516] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.332697] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 1867a1f0-711a-441e-8513-0621401e152c is going to be created. [ 1203.353487] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.353797] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.353954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.354328] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.354683] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.355074] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-1867a1f0-711a-441e-8513-0621401e152c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.249565] env[69756]: INFO networking_nsxv3.common.synchronization [req-a30bed13-d14e-421d-8bfd-cef4fe7fd519 req-034a9e97-8f96-4448-941b-96b96921a8ba service nova] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_rules [ 1204.249565] env[69756]: INFO networking_nsxv3.common.synchronization [req-a30bed13-d14e-421d-8bfd-cef4fe7fd519 req-034a9e97-8f96-4448-941b-96b96921a8ba service nova] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1204.249565] env[69756]: INFO networking_nsxv3.common.synchronization [req-a30bed13-d14e-421d-8bfd-cef4fe7fd519 req-034a9e97-8f96-4448-941b-96b96921a8ba service nova] Enqueued Resource ID: 1867a1f0-711a-441e-8513-0621401e152c with Priority: HIGHEST for action port [ 1204.249565] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_rules [ 1204.249565] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1204.249565] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1867a1f0-711a-441e-8513-0621401e152c with Priority: HIGHEST for action port [ 1204.249565] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.249565] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.249565] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.249565] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.249565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.250839] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.250839] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1867a1f0-711a-441e-8513-0621401e152c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.250839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1867a1f0-711a-441e-8513-0621401e152c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.250839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1867a1f0-711a-441e-8513-0621401e152c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.250839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1867a1f0-711a-441e-8513-0621401e152c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.250839] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1867a1f0-711a-441e-8513-0621401e152c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.433962] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1204.434205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.434382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.434634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.434833] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.434956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.435047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.435260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.435333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.435415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.435507] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.713302] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.713479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.713634] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.714737] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1867a1f0-711a-441e-8513-0621401e152c with status ACTIVE [ 1204.714972] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.715163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.715277] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.715570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.716232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.716232] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.716232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.716232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.716528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.716528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.716746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.716912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.716912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.717092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.717211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.717341] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1867a1f0-711a-441e-8513-0621401e152c is going to be updated. [ 1204.724993] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1204.725239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.742155] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.742307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.742378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.742593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.742761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.742957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1867a1f0-711a-441e-8513-0621401e152c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.938492] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.938647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.938714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.938945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.939142] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.939251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.939319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.939476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.939564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.939657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.939803] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.939921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.939983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.940144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.940282] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.940375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.940436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.940572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.940649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.940748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.940847] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.219692] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.444114] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48c09f21-41e5-4def-8d66-8a36711be55a: rpc.has_security_group_logging(os_id): False [ 1205.464508] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.464680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.464838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.465191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.465364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.465752] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.465943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.466092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.466361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.466907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.466907] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.466907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.466907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.467102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.467166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.467401] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.467587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.467695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.468043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.468245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.468367] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1205.532313] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.533338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.533338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.533338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.533338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.551903] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1205.724020] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.724020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.724020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.724020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.724020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.724020] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e14423-20f6-4632-a776-83c92acbd98e is going to be created. [ 1205.749493] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.749493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.749710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.750115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.750398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.764373] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: UNINITIALIZED for 2s [ 1207.572489] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1207.572489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.775551] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: SUCCESS [ 1207.775678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.776182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.776182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.776276] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.776357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.776421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.776573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.776648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.776731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.776818] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.279655] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.279655] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.279898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.279963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.280138] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.280294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.280294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.280453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.280539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.280629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.280830] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.280897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.280933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.281829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.281829] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.281829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.281829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.281829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.281829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.281829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.281829] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.784422] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6e14423-20f6-4632-a776-83c92acbd98e: rpc.has_security_group_logging(os_id): False [ 1208.804513] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.804686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.804719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.805062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.805168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.805383] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.805484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.805558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.805789] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.805882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.806100] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.806213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.806288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.806403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.806473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.806659] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.806754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.806815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.806956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.807043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.807152] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e14423-20f6-4632-a776-83c92acbd98e is going to be created. [ 1208.873282] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.873496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.873496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.873749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.873912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.887784] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: IN_PROGRESS for 2s [ 1209.201695] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1209.201835] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1209.696425] env[69756]: INFO networking_nsxv3.common.synchronization [req-a1a6439a-e178-4eb1-9770-94518cb79361 req-a24718e1-4ca5-4234-acd9-b56e71049e9e tempest-VolumesAdminNegativeTest-1357987219 tempest-VolumesAdminNegativeTest-1357987219-project-member] Enqueued Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_members [ 1209.696936] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_members [ 1209.697349] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76720d0-5804-46fa-8a2f-21842f720546 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.697517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.697581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.697854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.698069] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.698220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.698285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.698509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.698621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.698762] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.076352] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.076352] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-449" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.076724] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-449" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.076724] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-449" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.076954] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.077135] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.077261] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.077483] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.077635] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.077877] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.077987] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.078120] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.078315] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.078415] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.078544] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.078688] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.097650] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.097823] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1210.097969] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.098183] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-449" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.098709] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-a2755049-8d04-4f47-a41e-61046f15688b taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.098903] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-a2755049-8d04-4f47-a41e-61046f15688b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.099076] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-a2755049-8d04-4f47-a41e-61046f15688b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.099418] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-a2755049-8d04-4f47-a41e-61046f15688b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.099587] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2755049-8d04-4f47-a41e-61046f15688b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.201400] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.201621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.201698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.201929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.202100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.202310] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.202408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.202472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.202630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.202706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.202810] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76720d0-5804-46fa-8a2f-21842f720546 already deleted. [ 1210.202908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.602080] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.602479] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.602479] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.602757] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.602928] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.603143] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port a2755049-8d04-4f47-a41e-61046f15688b not found, creating... [ 1210.603421] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.603585] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.603748] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.604152] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.604221] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.604537] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.604703] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.604846] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.605812] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.605812] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.605812] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: a2755049-8d04-4f47-a41e-61046f15688b is going to be created. [ 1210.634953] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.634953] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.634953] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.635241] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.635552] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.635869] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-a2755049-8d04-4f47-a41e-61046f15688b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.899530] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: SUCCESS [ 1210.899626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.468243] env[69756]: INFO networking_nsxv3.common.synchronization [req-a1a6439a-e178-4eb1-9770-94518cb79361 req-4349fec7-8288-4576-9130-917711b2306e service nova] Enqueued Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_rules [ 1211.468470] env[69756]: INFO networking_nsxv3.common.synchronization [req-a1a6439a-e178-4eb1-9770-94518cb79361 req-4349fec7-8288-4576-9130-917711b2306e service nova] Enqueued Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_members [ 1211.468558] env[69756]: INFO networking_nsxv3.common.synchronization [req-a1a6439a-e178-4eb1-9770-94518cb79361 req-4349fec7-8288-4576-9130-917711b2306e service nova] Enqueued Resource ID: a2755049-8d04-4f47-a41e-61046f15688b with Priority: HIGHEST for action port [ 1211.468769] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_rules [ 1211.468894] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_members [ 1211.468995] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2755049-8d04-4f47-a41e-61046f15688b with Priority: HIGHEST for action port [ 1211.469569] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76720d0-5804-46fa-8a2f-21842f720546 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.469722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.469750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.469964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.476145] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.477129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76720d0-5804-46fa-8a2f-21842f720546 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.477264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.477335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.477538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.477691] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.477795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.478154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.478154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.478154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.478262] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.478985] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2755049-8d04-4f47-a41e-61046f15688b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.479098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2755049-8d04-4f47-a41e-61046f15688b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.479167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2755049-8d04-4f47-a41e-61046f15688b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.479352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2755049-8d04-4f47-a41e-61046f15688b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.479395] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2755049-8d04-4f47-a41e-61046f15688b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.524119] env[69756]: INFO networking_nsxv3.common.synchronization [req-90980e02-8096-474e-b456-36cbbd21d31f req-7530d055-42bb-4a7b-98bb-bdd9179d3abb tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1211.524119] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1211.524119] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.524119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.524119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.524119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.524119] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.524119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.524119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.524119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.524821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.525024] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.837402] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.838280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.838280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.838280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.838280] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.838554] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.838582] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.838779] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.838926] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.839149] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.839267] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.839380] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.839737] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.839737] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.839814] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.839923] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.860841] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.861030] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1211.861179] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.861358] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.861675] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-d8526863-dc0a-4992-bf96-a51f2d921858 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.861851] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-d8526863-dc0a-4992-bf96-a51f2d921858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.861976] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-d8526863-dc0a-4992-bf96-a51f2d921858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.862398] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-d8526863-dc0a-4992-bf96-a51f2d921858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.862570] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8526863-dc0a-4992-bf96-a51f2d921858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.982415] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.983550] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76720d0-5804-46fa-8a2f-21842f720546 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.983666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.983837] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2755049-8d04-4f47-a41e-61046f15688b with status ACTIVE [ 1211.983999] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.984123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.984191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.984404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.984489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.984657] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.984754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.984841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.984970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.985062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.985270] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.985472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.985557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.985712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.985788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.985875] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2755049-8d04-4f47-a41e-61046f15688b is going to be updated. [ 1212.013268] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.013268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.013268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.013268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.013268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.013268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2755049-8d04-4f47-a41e-61046f15688b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.029699] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.029699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.029699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.029699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.029699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.029699] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.029699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.029699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.029699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.029699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.029699] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1212.056746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.056746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.056746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.056746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.056746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.066313] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1212.367954] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.367954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.367954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.367954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.368325] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.368413] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port d8526863-dc0a-4992-bf96-a51f2d921858 not found, creating... [ 1212.368890] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.369179] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.369380] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.369738] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.369999] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.370501] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.370754] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.370990] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.371402] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.371589] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.371786] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: d8526863-dc0a-4992-bf96-a51f2d921858 is going to be created. [ 1212.402929] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.403354] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.403507] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.403839] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.404134] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.404406] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-d8526863-dc0a-4992-bf96-a51f2d921858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.488285] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.991171] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.991877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.991877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.991877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.991877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.991877] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76720d0-5804-46fa-8a2f-21842f720546 is going to be created. [ 1213.018251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.018408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.018466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.018680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.018842] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.031419] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76720d0-5804-46fa-8a2f-21842f720546 in Status: UNINITIALIZED for 2s [ 1213.124520] env[69756]: INFO networking_nsxv3.common.synchronization [req-90980e02-8096-474e-b456-36cbbd21d31f req-75746840-07e4-4b44-bd22-26984e3ae308 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1213.125087] env[69756]: INFO networking_nsxv3.common.synchronization [req-90980e02-8096-474e-b456-36cbbd21d31f req-75746840-07e4-4b44-bd22-26984e3ae308 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1213.125352] env[69756]: INFO networking_nsxv3.common.synchronization [req-90980e02-8096-474e-b456-36cbbd21d31f req-75746840-07e4-4b44-bd22-26984e3ae308 service nova] Enqueued Resource ID: d8526863-dc0a-4992-bf96-a51f2d921858 with Priority: HIGHEST for action port [ 1213.125889] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1213.127575] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1213.127747] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8526863-dc0a-4992-bf96-a51f2d921858 with Priority: HIGHEST for action port [ 1213.128093] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.128231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.128301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.128508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.128588] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.129521] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.129576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.130176] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8526863-dc0a-4992-bf96-a51f2d921858 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.130303] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8526863-dc0a-4992-bf96-a51f2d921858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.130373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8526863-dc0a-4992-bf96-a51f2d921858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.131371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8526863-dc0a-4992-bf96-a51f2d921858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.131371] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8526863-dc0a-4992-bf96-a51f2d921858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.633289] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.633645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.633645] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8526863-dc0a-4992-bf96-a51f2d921858 with status ACTIVE [ 1213.633769] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.633847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.633922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.634185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.634292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.634470] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.634605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.634698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.634943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.635062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.635372] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.635498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.635563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.635717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.635850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.635978] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8526863-dc0a-4992-bf96-a51f2d921858 is going to be updated. [ 1213.661486] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.661798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.661883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.662269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.662529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.662813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8526863-dc0a-4992-bf96-a51f2d921858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.079071] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1214.079270] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 deletion is rescheduled due to dependency. [ 1214.079404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.079570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.079878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.080116] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.080242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.080309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.080581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.080581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.080676] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.582906] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.042598] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76720d0-5804-46fa-8a2f-21842f720546 in Status: SUCCESS [ 1215.043047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.043047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.043331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.043605] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.043810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.043910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.044184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.044315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.044432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.044566] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.088098] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.547151] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.575014] env[69756]: INFO networking_nsxv3.common.synchronization [req-a37976bf-ffef-47e3-a625-59b538f0753c req-82cc056c-1834-4f1d-a431-c577aa5b5296 tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1215.575551] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1215.575860] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.575983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.576093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.576274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.576428] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.576527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.576589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.576748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.576827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.576919] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.592267] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.592434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.592504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.592719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.592803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.592896] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1215.621951] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.622209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.622286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.622497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.622638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.632517] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1216.035333] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.038492] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.038929] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.039370] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.039715] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.039987] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.040223] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.040512] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.040675] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.040923] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.041058] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.042115] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.042115] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.042115] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.042115] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.042115] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.049461] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76720d0-5804-46fa-8a2f-21842f720546: rpc.has_security_group_logging(os_id): False [ 1216.075164] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.078535] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1216.078535] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.078535] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.078535] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-c5e0abe7-73b8-4480-9df3-75727012cfda taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.078535] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-c5e0abe7-73b8-4480-9df3-75727012cfda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.078535] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-c5e0abe7-73b8-4480-9df3-75727012cfda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.078535] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-c5e0abe7-73b8-4480-9df3-75727012cfda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.078535] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e0abe7-73b8-4480-9df3-75727012cfda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.080026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.080240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.080348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.080666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.080830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.081178] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.081452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.081492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.081776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.081944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.082147] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1216.085203] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.085569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.085569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.085839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.086121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.086536] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.086625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.086718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.087011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.087181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.087355] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76720d0-5804-46fa-8a2f-21842f720546 is going to be created. [ 1216.117570] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.117787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.117890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.118268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.118531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.130725] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1216.164253] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.164421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.164474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.164694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.164902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.194797] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76720d0-5804-46fa-8a2f-21842f720546 in Status: IN_PROGRESS for 2s [ 1216.585751] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.585751] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.585751] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.586106] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.586380] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.586649] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port c5e0abe7-73b8-4480-9df3-75727012cfda not found, creating... [ 1216.587116] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.587410] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.587633] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.588014] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.588221] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.588550] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.588718] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.588842] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.589095] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.589302] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.589541] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: c5e0abe7-73b8-4480-9df3-75727012cfda is going to be created. [ 1216.611505] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.611786] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.611871] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.612608] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.612937] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.613214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-c5e0abe7-73b8-4480-9df3-75727012cfda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.322115] env[69756]: INFO networking_nsxv3.common.synchronization [req-a37976bf-ffef-47e3-a625-59b538f0753c req-725ec492-c62b-43c4-b8c1-0fa72694f9a2 service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 1217.322115] env[69756]: INFO networking_nsxv3.common.synchronization [req-a37976bf-ffef-47e3-a625-59b538f0753c req-725ec492-c62b-43c4-b8c1-0fa72694f9a2 service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1217.322115] env[69756]: INFO networking_nsxv3.common.synchronization [req-a37976bf-ffef-47e3-a625-59b538f0753c req-725ec492-c62b-43c4-b8c1-0fa72694f9a2 service nova] Enqueued Resource ID: c5e0abe7-73b8-4480-9df3-75727012cfda with Priority: HIGHEST for action port [ 1217.322115] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 1217.322115] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1217.322115] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5e0abe7-73b8-4480-9df3-75727012cfda with Priority: HIGHEST for action port [ 1217.322115] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.322115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.322115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.323403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.323643] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.324999] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.325252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.325577] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5e0abe7-73b8-4480-9df3-75727012cfda taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.325936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5e0abe7-73b8-4480-9df3-75727012cfda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.326109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5e0abe7-73b8-4480-9df3-75727012cfda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.326802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5e0abe7-73b8-4480-9df3-75727012cfda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.327101] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e0abe7-73b8-4480-9df3-75727012cfda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.645874] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1217.645874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.645874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.645874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.645874] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.645874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.645874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.645874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.645874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.645874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.645874] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.830409] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.830778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.831034] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5e0abe7-73b8-4480-9df3-75727012cfda with status ACTIVE [ 1217.831222] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.831335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.831401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.831614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.831699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.831869] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.831963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.832141] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.832383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.832480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.832681] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.832786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.832934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.833237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.833237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.833326] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5e0abe7-73b8-4480-9df3-75727012cfda is going to be updated. [ 1217.855764] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.855912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.855947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.856172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.856315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.856479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5e0abe7-73b8-4480-9df3-75727012cfda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.120845] env[69756]: INFO networking_nsxv3.common.synchronization [req-968eb434-4065-45fc-a67a-bad7a0cb05c0 req-1c4c098d-06b7-4e3d-9b4a-2fc8455afe49 tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1218.121428] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1218.121756] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.122062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.122164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.122382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.122554] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.122662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.122726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.122877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.122966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.123097] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.142374] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1218.142588] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 1218.142709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.142865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.143209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.143394] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.143510] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.143575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.143738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.143820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.143913] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.149300] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.149444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.149444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.149645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.149811] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.149952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.150100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.150250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.150288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.150383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.150534] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.150632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.150774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.150830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.150969] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.151078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.151167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.151273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.151348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.151429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.151519] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.208168] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76720d0-5804-46fa-8a2f-21842f720546 in Status: SUCCESS [ 1218.208411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.625070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.625508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.625508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.625634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.625680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.625870] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.625988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.626064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.626237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.626392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.626464] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1218.645976] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.653843] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77ecb29c-d932-487b-b95d-59676b2a2f50: rpc.has_security_group_logging(os_id): False [ 1218.656877] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.657131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.657131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.657280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.657416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.668357] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1218.680107] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.683044] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.683044] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.683044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.683577] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.683577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.683577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.683577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.683577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.683577] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1218.758613] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.758815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.758936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.759305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.759528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.781682] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1218.804308] env[69756]: INFO networking_nsxv3.common.synchronization [req-968eb434-4065-45fc-a67a-bad7a0cb05c0 req-2a6b451b-a050-4c35-8165-d7720dab4ada tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1218.804869] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1218.805511] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.806264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.014281] env[69756]: INFO networking_nsxv3.common.synchronization [None req-55473928-3f09-4148-82b5-6aa551f75285 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1219.014923] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1219.015599] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.015747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.015817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.016345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.016561] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.016823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.016823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.017339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.017485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.017643] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.149228] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.359029] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-247 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.359195] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-247" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.359333] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-247" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.359677] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-247" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.359951] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.360155] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.360287] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.360520] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.360671] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.360890] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.361016] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.361158] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.361300] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.361423] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.361536] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.361674] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.385902] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.386112] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1219.386314] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.386450] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-247" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.386766] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.386943] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.387083] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.387426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.387574] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0d5c38f-2299-4e23-b5e5-3af44fe5707a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.522923] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.651292] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.651782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.651782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.651961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.652231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.652357] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1219.689852] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.690070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.690165] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.690460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.690664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.701621] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1219.889983] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.890417] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.890521] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.890854] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.891069] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.891314] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port a0d5c38f-2299-4e23-b5e5-3af44fe5707a not found, creating... [ 1219.891755] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.892333] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.892333] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.892441] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.892819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.893045] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.893279] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.893451] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.893744] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.893975] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.894307] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: a0d5c38f-2299-4e23-b5e5-3af44fe5707a is going to be created. [ 1219.924030] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.924030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.924030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.924030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.924030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.924030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.025816] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.530127] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.530290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.530354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.530619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.530817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.530817] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1220.562980] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.562980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.563172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.563313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.563457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.572256] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1220.623137] env[69756]: INFO networking_nsxv3.common.synchronization [req-968eb434-4065-45fc-a67a-bad7a0cb05c0 req-dde50b02-9290-4d9d-adfe-7c72ff1cb27d service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1220.623325] env[69756]: INFO networking_nsxv3.common.synchronization [req-968eb434-4065-45fc-a67a-bad7a0cb05c0 req-dde50b02-9290-4d9d-adfe-7c72ff1cb27d service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1220.623485] env[69756]: INFO networking_nsxv3.common.synchronization [req-968eb434-4065-45fc-a67a-bad7a0cb05c0 req-dde50b02-9290-4d9d-adfe-7c72ff1cb27d service nova] Enqueued Resource ID: a0d5c38f-2299-4e23-b5e5-3af44fe5707a with Priority: HIGHEST for action port [ 1220.624168] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1220.624426] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1220.624508] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d5c38f-2299-4e23-b5e5-3af44fe5707a with Priority: HIGHEST for action port [ 1220.624796] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.624920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.624986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.625261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.625352] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.629017] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.629017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.629017] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.629017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.629017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.629017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.629017] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0d5c38f-2299-4e23-b5e5-3af44fe5707a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.679725] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1220.680017] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed deletion is rescheduled due to dependency. [ 1220.680017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.680185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.680400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.680581] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.680692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.680755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.681386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.681386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.681386] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.797112] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1220.797623] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.133596] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.133725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.133917] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0d5c38f-2299-4e23-b5e5-3af44fe5707a with status ACTIVE [ 1221.134113] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.134212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.134274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.134494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.134578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.134749] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.134844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.134906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.135067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.135147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.135322] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.135415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.135476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.135618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.135685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.135770] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0d5c38f-2299-4e23-b5e5-3af44fe5707a is going to be updated. [ 1221.164948] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.165118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.165183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.166218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.166218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.166218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0d5c38f-2299-4e23-b5e5-3af44fe5707a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.183229] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.342936] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.343169] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.343312] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.343592] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.343857] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.344209] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.344389] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.344628] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.344784] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.345102] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.345156] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.345314] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.345352] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.345468] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.345582] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.345723] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.372660] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.372660] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1221.372660] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.372938] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.373217] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-1c3e177b-5035-4d2c-af99-1934689d74ad taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.373341] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-1c3e177b-5035-4d2c-af99-1934689d74ad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.373435] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-1c3e177b-5035-4d2c-af99-1934689d74ad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.373790] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-1c3e177b-5035-4d2c-af99-1934689d74ad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.373929] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c3e177b-5035-4d2c-af99-1934689d74ad',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.496729] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.497039] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-678" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.497103] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-678" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.497451] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-678" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.497862] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.498323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.498494] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.498760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.498916] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.499138] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.499259] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.499375] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.499494] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.499608] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.499720] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.499892] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.521635] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.521926] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1221.522172] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.522426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-678" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.522871] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.523408] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.523615] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.524113] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.524256] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1adaf8ca-b983-49a8-a3cf-96e40d6eee0d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.685343] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.712587] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1221.712782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.713379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.713612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.713806] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.713923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.713989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.714161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.714260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.714329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.714460] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.879323] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.879323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.879323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.879323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.879323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.879323] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 1c3e177b-5035-4d2c-af99-1934689d74ad not found, creating... [ 1221.879323] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.879323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.879323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.879323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.879323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.881473] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.881866] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.884199] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.884199] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.884199] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.884199] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 1c3e177b-5035-4d2c-af99-1934689d74ad is going to be created. [ 1221.907541] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.908788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.908788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.910527] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.910527] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.910527] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-1c3e177b-5035-4d2c-af99-1934689d74ad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.030836] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.031693] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.031693] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.031693] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.031863] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.032243] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 1adaf8ca-b983-49a8-a3cf-96e40d6eee0d not found, creating... [ 1222.032342] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.034269] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.034496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.034801] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.034965] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.035786] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.035786] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.035786] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.036212] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.036426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.037679] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 1adaf8ca-b983-49a8-a3cf-96e40d6eee0d is going to be created. [ 1222.064018] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.064355] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.064496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.064779] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.065038] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.065265] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.081157] env[69756]: INFO networking_nsxv3.common.synchronization [req-331ebb3d-1f05-4119-a46c-a9393bd4b17a req-fe6568d7-d343-4db2-814c-2921aacb1a22 tempest-ImagesTestJSON-1358045384 tempest-ImagesTestJSON-1358045384-project-member] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1222.082069] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGHEST for action security_group_members [ 1222.082264] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.082412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.082481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.082726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.083858] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.083951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.084011] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.084209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.084307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.084443] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.187803] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.188016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.188016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.188250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.188345] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.188442] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1222.217414] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.217585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.217656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.217882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.218112] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.218255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.218295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.218461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.218678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.218678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.218783] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.218860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.218915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.219070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.219322] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.219614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.219703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.219871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.219961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.220092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.220189] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.235574] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.235737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.235737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.236189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.236189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.248470] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1222.587775] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.587925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.587996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.588261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.588379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.588583] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.588690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.588754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.588909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.588984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.589085] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be updated. [ 1222.615288] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1222.615288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.624082] env[69756]: INFO networking_nsxv3.common.synchronization [None req-bf396740-fafe-48f0-bd86-eb64410f5dc3 tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_rules [ 1222.624631] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_rules [ 1222.624942] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.625292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.625393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.625841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.625841] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.630493] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.631232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.631232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.631232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.631232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.642824] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: IN_PROGRESS for 2s [ 1222.723438] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d711ed5-98da-4810-9f03-9148ad645008: rpc.has_security_group_logging(os_id): False [ 1222.743388] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.743602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.743721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.744025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.744147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.744438] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.744616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.744698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.748514] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.748514] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.748514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.748514] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1222.770507] env[69756]: INFO networking_nsxv3.common.synchronization [None req-f6fc67ea-ff4b-41e3-81b1-a01c4ec9e70b tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_rules [ 1222.774203] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_rules [ 1222.774763] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.774872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.814171] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.814171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.814171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.814171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.814171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.816477] env[69756]: INFO networking_nsxv3.common.synchronization [req-2cdf7855-9d16-400a-9157-1b556d1a6242 req-b6d2b974-e112-4be3-b313-7c3b512d3e01 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1222.817088] env[69756]: INFO networking_nsxv3.common.synchronization [req-2cdf7855-9d16-400a-9157-1b556d1a6242 req-b6d2b974-e112-4be3-b313-7c3b512d3e01 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1222.817088] env[69756]: INFO networking_nsxv3.common.synchronization [req-2cdf7855-9d16-400a-9157-1b556d1a6242 req-b6d2b974-e112-4be3-b313-7c3b512d3e01 service nova] Enqueued Resource ID: 1c3e177b-5035-4d2c-af99-1934689d74ad with Priority: HIGHEST for action port [ 1222.818289] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1222.818289] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1222.818395] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c3e177b-5035-4d2c-af99-1934689d74ad with Priority: HIGHEST for action port [ 1222.818668] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.818815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.818894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.819296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.819400] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.820940] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.820940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.820940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.820940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.821162] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.821162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.821241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.824440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.824440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.824440] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.824440] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c3e177b-5035-4d2c-af99-1934689d74ad taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.824440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c3e177b-5035-4d2c-af99-1934689d74ad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.824440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c3e177b-5035-4d2c-af99-1934689d74ad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.824440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c3e177b-5035-4d2c-af99-1934689d74ad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.824440] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c3e177b-5035-4d2c-af99-1934689d74ad',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.832235] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1222.911513] env[69756]: INFO networking_nsxv3.common.synchronization [req-968eb434-4065-45fc-a67a-bad7a0cb05c0 req-f867138c-e965-4889-9aaf-84bbe148e252 service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1222.911691] env[69756]: INFO networking_nsxv3.common.synchronization [req-968eb434-4065-45fc-a67a-bad7a0cb05c0 req-f867138c-e965-4889-9aaf-84bbe148e252 service nova] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1222.911840] env[69756]: INFO networking_nsxv3.common.synchronization [req-968eb434-4065-45fc-a67a-bad7a0cb05c0 req-f867138c-e965-4889-9aaf-84bbe148e252 service nova] Enqueued Resource ID: 1adaf8ca-b983-49a8-a3cf-96e40d6eee0d with Priority: HIGHEST for action port [ 1222.912558] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_rules [ 1222.912691] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1222.912789] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1adaf8ca-b983-49a8-a3cf-96e40d6eee0d with Priority: HIGHEST for action port [ 1222.913238] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.913401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.913714] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.913848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.914121] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.914256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.914329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.914574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.914680] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1adaf8ca-b983-49a8-a3cf-96e40d6eee0d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.148876] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.149108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.149108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.149306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.149403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.149507] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 already deleted. [ 1223.149592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.149752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.149919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.150016] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.324439] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.325559] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.325670] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.325901] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c3e177b-5035-4d2c-af99-1934689d74ad with status ACTIVE [ 1223.326117] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.326278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.326375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.326663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.327023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.327099] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.327215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.327296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.327523] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.327606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.327808] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.327916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.330292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.330292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.330292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.330416] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c3e177b-5035-4d2c-af99-1934689d74ad is going to be updated. [ 1223.353582] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.353726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.353825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.354055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.354196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.354357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c3e177b-5035-4d2c-af99-1934689d74ad" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.416746] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1adaf8ca-b983-49a8-a3cf-96e40d6eee0d with status ACTIVE [ 1223.416981] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.417179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.417237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.417411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.417708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.417902] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.418009] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.418079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.418248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.418327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.418544] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.418606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.418652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.418791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.418866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.418951] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1adaf8ca-b983-49a8-a3cf-96e40d6eee0d is going to be updated. [ 1223.440580] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.440743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.440805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.441020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.442973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.442973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1adaf8ca-b983-49a8-a3cf-96e40d6eee0d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.537537] env[69756]: INFO networking_nsxv3.common.synchronization [req-cd6e8207-d9f0-43c8-8168-13af70f5fa62 req-24c1ff7e-fcf7-4fb5-ab01-20651b7c5655 tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_members [ 1223.538121] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_members [ 1223.538480] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.538611] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.538680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.539212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.539212] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.539212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.539446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.539446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.539533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.539631] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.671461] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.671736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.671736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.671879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.671879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.671968] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 already deleted. [ 1223.672102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.833691] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.878060] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.879104] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.879426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.879982] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.880674] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.881008] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.881264] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.881557] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.881866] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.882214] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1223.882410] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1223.882592] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1223.882750] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1223.882912] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1223.883882] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1223.883882] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1223.904937] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1223.905861] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1223.905861] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1223.905861] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.905861] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.906122] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.906206] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.906649] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.906783] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('942b2e0e-d3b5-4022-b237-035a7ca9e9d5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.044297] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.044473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.044561] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.044787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.044874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.045079] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.045181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.045244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.045393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.045468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.045553] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 already deleted. [ 1224.045633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.262892] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1224.263616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.264037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.265171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.265443] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.265616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.266479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.266796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.266968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.267224] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.338246] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.338246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.338246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.338246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.338246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.338246] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1224.367067] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.367273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.367356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.367618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.367790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.377759] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1224.409758] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.410219] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.410438] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.410775] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.410943] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.411153] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 942b2e0e-d3b5-4022-b237-035a7ca9e9d5 not found, creating... [ 1224.411433] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.411605] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.411774] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.411974] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.412203] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.412505] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.412671] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.412812] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.413837] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.413837] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.413837] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 942b2e0e-d3b5-4022-b237-035a7ca9e9d5 is going to be created. [ 1224.437172] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.437340] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.437470] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.437767] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.438041] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.438270] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.655787] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c09f21-41e5-4def-8d66-8a36711be55a in Status: SUCCESS [ 1224.656041] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a deletion is rescheduled due to dependency. [ 1224.656236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.770259] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.851448] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1224.851826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.151276] env[69756]: INFO networking_nsxv3.common.synchronization [req-cd6e8207-d9f0-43c8-8168-13af70f5fa62 req-b1b25c70-1c07-4db6-93e8-1f03dacba321 service nova] Enqueued Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_rules [ 1225.151276] env[69756]: INFO networking_nsxv3.common.synchronization [req-cd6e8207-d9f0-43c8-8168-13af70f5fa62 req-b1b25c70-1c07-4db6-93e8-1f03dacba321 service nova] Enqueued Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_members [ 1225.151276] env[69756]: INFO networking_nsxv3.common.synchronization [req-cd6e8207-d9f0-43c8-8168-13af70f5fa62 req-b1b25c70-1c07-4db6-93e8-1f03dacba321 service nova] Enqueued Resource ID: 942b2e0e-d3b5-4022-b237-035a7ca9e9d5 with Priority: HIGHEST for action port [ 1225.151674] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_rules [ 1225.151674] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_members [ 1225.151674] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 942b2e0e-d3b5-4022-b237-035a7ca9e9d5 with Priority: HIGHEST for action port [ 1225.153794] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.153794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.153794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.153794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.153794] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.155196] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.155336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.156033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.156033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.156033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.156033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.156033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.156033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.156557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.156557] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.157042] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.157168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.157280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.157439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.157627] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('942b2e0e-d3b5-4022-b237-035a7ca9e9d5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.273053] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.655985] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.656154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.660605] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 942b2e0e-d3b5-4022-b237-035a7ca9e9d5 with status ACTIVE [ 1225.660850] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.661053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.661302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.661559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.661678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.661881] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.661991] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.662119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.662253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.662356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.662545] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.662632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.662692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.662833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.662906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.662988] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 942b2e0e-d3b5-4022-b237-035a7ca9e9d5 is going to be updated. [ 1225.664104] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.688179] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.688179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.688297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.688507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.688653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.688829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-942b2e0e-d3b5-4022-b237-035a7ca9e9d5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.776508] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.776508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.776508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.776508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.776508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.776508] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1225.829354] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.829531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.829571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.829781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.829980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.839618] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1225.991244] env[69756]: INFO networking_nsxv3.common.synchronization [req-c983bb72-5697-4407-adf4-f5d4446962cc req-e3fa301c-1f2c-4528-a424-00bd943193b3 tempest-ServerRescueNegativeTestJSON-1656302266 tempest-ServerRescueNegativeTestJSON-1656302266-project-member] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1225.991244] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1225.991244] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.991244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.991244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.991244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.991244] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.991244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.991244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.991244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.991244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.991946] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.166784] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.390045] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1226.393317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.393499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.393719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.393918] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.394053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.394121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.394284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.394405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.394584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.394584] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.494390] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.494585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.494683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.494993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.495201] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.495373] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.495512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.495598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.495807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.495940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.496042] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f already deleted. [ 1226.496162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.672571] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.672744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.672806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.673125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.673209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.673317] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 is going to be created. [ 1226.699184] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.699356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.699487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.699602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.699758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.708745] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.708984] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.709194] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.709540] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.709845] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.710108] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.710544] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.710544] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.710681] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.710889] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.711019] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.711143] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.711257] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.711372] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.711481] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.711615] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.713260] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 in Status: UNINITIALIZED for 2s [ 1226.730172] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.730486] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1226.730627] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.730701] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.731025] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-d9c77b34-b636-4b15-9511-b7583b245cb4 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.731205] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-d9c77b34-b636-4b15-9511-b7583b245cb4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.731330] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-d9c77b34-b636-4b15-9511-b7583b245cb4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.731707] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-d9c77b34-b636-4b15-9511-b7583b245cb4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.731817] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9c77b34-b636-4b15-9511-b7583b245cb4',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.897648] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.897906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.897984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.898273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.898469] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.898713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.898713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.898860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.898951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.899055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.899734] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.899734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.899734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.899734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.899734] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.899965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.899965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.900052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.900148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.900278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.900387] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.234470] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.234699] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.234699] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.234982] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.235181] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.235472] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port d9c77b34-b636-4b15-9511-b7583b245cb4 not found, creating... [ 1227.235792] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.235965] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.236109] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.236360] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.236505] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.236805] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.236972] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.237112] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.237341] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.237799] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.237799] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: d9c77b34-b636-4b15-9511-b7583b245cb4 is going to be created. [ 1227.263357] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.263624] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.263783] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.265148] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.265441] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.267433] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-d9c77b34-b636-4b15-9511-b7583b245cb4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.403775] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77ecb29c-d932-487b-b95d-59676b2a2f50: rpc.has_security_group_logging(os_id): False [ 1227.435477] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.435682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.435724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.435978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.436118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.436328] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.436456] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.436534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.436728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.436830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.437017] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.437767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.437916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.438136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.438309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.438512] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.438631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.438694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.438934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.439040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.439137] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1227.519392] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.520057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.520158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.520382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.520524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.534917] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1227.851436] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1227.851738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.851949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.852312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.852568] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.852700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.852770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.852951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.853114] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.853262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.853372] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.854271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.854473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.854654] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.854818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.854907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.855088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.855173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.855266] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.045814] env[69756]: INFO networking_nsxv3.common.synchronization [req-c983bb72-5697-4407-adf4-f5d4446962cc req-70f24171-6897-4d93-9c50-b2d69ddd8cf3 service nova] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_rules [ 1228.046064] env[69756]: INFO networking_nsxv3.common.synchronization [req-c983bb72-5697-4407-adf4-f5d4446962cc req-70f24171-6897-4d93-9c50-b2d69ddd8cf3 service nova] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1228.046222] env[69756]: INFO networking_nsxv3.common.synchronization [req-c983bb72-5697-4407-adf4-f5d4446962cc req-70f24171-6897-4d93-9c50-b2d69ddd8cf3 service nova] Enqueued Resource ID: d9c77b34-b636-4b15-9511-b7583b245cb4 with Priority: HIGHEST for action port [ 1228.046790] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_rules [ 1228.047158] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1228.047158] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9c77b34-b636-4b15-9511-b7583b245cb4 with Priority: HIGHEST for action port [ 1228.047741] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.047911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.048015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.048312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.048427] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.049337] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.049547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.049601] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.049801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.050027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.050126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.050230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.050418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.050501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.050615] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.052340] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9c77b34-b636-4b15-9511-b7583b245cb4 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.052340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9c77b34-b636-4b15-9511-b7583b245cb4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.052340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9c77b34-b636-4b15-9511-b7583b245cb4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.052340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9c77b34-b636-4b15-9511-b7583b245cb4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.052340] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9c77b34-b636-4b15-9511-b7583b245cb4',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.358178] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.358178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.361111] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.479383] env[69756]: INFO networking_nsxv3.common.synchronization [req-45111d7a-8007-46c5-98e3-91af1b1af294 req-87fe2e8b-3b26-4992-b0d4-0518ba7403c2 tempest-ServerRescueNegativeTestJSON-1656302266 tempest-ServerRescueNegativeTestJSON-1656302266-project-member] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1228.480348] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1228.480348] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.480497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.554604] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.554897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.555072] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.556133] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9c77b34-b636-4b15-9511-b7583b245cb4 with status ACTIVE [ 1228.556257] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.556445] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.556552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.556888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.557051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.557441] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.557636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.557744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.558023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.558138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.558425] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.558498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.558825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.558825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.558825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.558987] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9c77b34-b636-4b15-9511-b7583b245cb4 is going to be updated. [ 1228.589567] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.589741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.589793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.590031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.590202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.590371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9c77b34-b636-4b15-9511-b7583b245cb4" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.727250] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 in Status: SUCCESS [ 1228.727627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.727885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.728222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.728518] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.728861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.728982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.729258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.729396] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.729550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.729702] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.830103] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.830321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.830453] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.830738] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.830994] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.831170] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.831293] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.831515] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.831665] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.831879] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1228.832012] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.832956] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.832956] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1228.832956] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1228.832956] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1228.832956] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1228.853168] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1228.853360] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1228.853568] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1228.853698] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.854345] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-53f7c1ff-44a0-4c31-94a2-becc50965038 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.854345] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-53f7c1ff-44a0-4c31-94a2-becc50965038" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.854345] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-53f7c1ff-44a0-4c31-94a2-becc50965038" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.854661] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-53f7c1ff-44a0-4c31-94a2-becc50965038" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.854802] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53f7c1ff-44a0-4c31-94a2-becc50965038',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.865622] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.061146] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.236932] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.356922] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.357202] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.357320] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.357674] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.357856] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.358029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 53f7c1ff-44a0-4c31-94a2-becc50965038 not found, creating... [ 1229.358339] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.358522] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.358657] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.358827] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.358990] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.359345] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.359514] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.359636] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.359845] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.360012] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.360655] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 53f7c1ff-44a0-4c31-94a2-becc50965038 is going to be created. [ 1229.367787] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.367952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.368045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.368293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.368388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.368492] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1229.385037] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.385374] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.385528] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.386531] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.386963] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.387313] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-53f7c1ff-44a0-4c31-94a2-becc50965038" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.401945] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.402206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.402206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.402441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.402625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.413025] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1229.555159] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1229.555313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.563926] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.564128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.564167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.564426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.564542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.564650] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f is going to be created. [ 1229.599527] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.599702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.599775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.600059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.600309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.612736] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: UNINITIALIZED for 2s [ 1229.739839] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a55f513a-b24f-43aa-8d5c-60a35c3553a1: rpc.has_security_group_logging(os_id): False [ 1229.762530] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.762848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.762848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.762942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.763009] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.763285] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.763406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.763442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.763625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.763703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.763851] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 is going to be created. [ 1229.839567] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.839760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.839823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.840132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.840354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.858219] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 in Status: IN_PROGRESS for 2s [ 1230.245708] env[69756]: INFO networking_nsxv3.common.synchronization [req-45111d7a-8007-46c5-98e3-91af1b1af294 req-2f0c4e2e-0db0-488a-8626-842f11f8cf94 service nova] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_rules [ 1230.245897] env[69756]: INFO networking_nsxv3.common.synchronization [req-45111d7a-8007-46c5-98e3-91af1b1af294 req-2f0c4e2e-0db0-488a-8626-842f11f8cf94 service nova] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1230.246056] env[69756]: INFO networking_nsxv3.common.synchronization [req-45111d7a-8007-46c5-98e3-91af1b1af294 req-2f0c4e2e-0db0-488a-8626-842f11f8cf94 service nova] Enqueued Resource ID: 53f7c1ff-44a0-4c31-94a2-becc50965038 with Priority: HIGHEST for action port [ 1230.246558] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_rules [ 1230.246693] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1230.246791] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53f7c1ff-44a0-4c31-94a2-becc50965038 with Priority: HIGHEST for action port [ 1230.247106] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.247225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.247470] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.247563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.247745] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-53f7c1ff-44a0-4c31-94a2-becc50965038 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.247848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53f7c1ff-44a0-4c31-94a2-becc50965038" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.247936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53f7c1ff-44a0-4c31-94a2-becc50965038" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.248133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53f7c1ff-44a0-4c31-94a2-becc50965038" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.248215] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53f7c1ff-44a0-4c31-94a2-becc50965038',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.603984] env[69756]: INFO networking_nsxv3.common.synchronization [req-758a894d-5978-45cf-a693-d0e85164d90e req-5a6d4287-d022-4dd5-8c84-292cce3137bb tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_members [ 1230.604878] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGHEST for action security_group_members [ 1230.604878] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.605165] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.605165] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.605584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.605584] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.605584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.605584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.605793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.605793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.605886] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.701285] env[69756]: INFO networking_nsxv3.common.synchronization [req-37ed6122-fcf1-4940-bedb-53baca5f052f req-45502a49-1f4b-4296-a163-492d0be4523a tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1230.701795] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1230.702119] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.702244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.702310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.702508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.702654] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.702747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.702806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.702963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.705035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.705035] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.751169] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53f7c1ff-44a0-4c31-94a2-becc50965038 with status ACTIVE [ 1230.751405] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.751541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.751608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.751828] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.751921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.752139] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.752238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.752300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.752455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.752533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.752713] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.752805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.752866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.753016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.753113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.753200] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53f7c1ff-44a0-4c31-94a2-becc50965038 is going to be updated. [ 1230.778907] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.778981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.779042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.779261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.779415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.779574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53f7c1ff-44a0-4c31-94a2-becc50965038" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.111251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.111429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.111632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.111749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.111877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.112236] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.112370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.112445] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.112665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.112769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.112883] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 is going to be updated. [ 1231.145221] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.145409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.145480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.145691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.145824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.156544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 in Status: IN_PROGRESS for 2s [ 1231.209917] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.209917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.209917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.210268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.210268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.210495] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.210600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.210657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.210811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.210887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.210975] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1231.253211] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.253211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.253211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.253211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.253211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.265035] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1231.423659] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1231.423952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.424187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.424545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.424804] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.424938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.425019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.425204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.425289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.425374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.425536] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.425634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.425696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.425841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.425979] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.426088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.426177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.426335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.426404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.426485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.426576] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.625845] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: SUCCESS [ 1231.626198] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.626395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.626468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.626629] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.626750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.626855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.626959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.627053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.627221] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.872160] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 in Status: SUCCESS [ 1231.872393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.930144] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6da75da-f8d6-4e54-8043-c3718b1492ed: rpc.has_security_group_logging(os_id): False [ 1231.945960] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.946132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.946184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.946394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.946487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.946684] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.946786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.946852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.947042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.947105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.947289] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.947385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.947449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.947595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.947672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.947851] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.947942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.947997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.948293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.948384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.948473] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1232.007998] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.008177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.008262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.008491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.008641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.012321] env[69756]: INFO networking_nsxv3.common.synchronization [req-979169fe-1715-4964-aa44-21ee861c60ab req-2361b57c-4ace-4d32-82da-593a2c28a74a tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1232.013059] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1232.013224] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.013344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.013434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.013696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.013897] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.015652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.015799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.016047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.016148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.016251] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.026844] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1232.129137] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.387828] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.388067] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.388242] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.388547] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.388849] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.389192] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.389364] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.389929] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.389929] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.390206] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.390403] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1232.390582] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1232.390745] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1232.391204] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.391204] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1232.391378] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1232.412359] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1232.412533] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1232.412679] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1232.412860] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.413220] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-f04ca19d-a94e-4453-8e47-fbaa9c096736 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.413411] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-f04ca19d-a94e-4453-8e47-fbaa9c096736" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.413540] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-f04ca19d-a94e-4453-8e47-fbaa9c096736" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.413900] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-f04ca19d-a94e-4453-8e47-fbaa9c096736" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.414019] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f04ca19d-a94e-4453-8e47-fbaa9c096736',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.518283] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.631728] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.916277] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.916528] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.916638] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.916929] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.917096] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.917281] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port f04ca19d-a94e-4453-8e47-fbaa9c096736 not found, creating... [ 1232.917541] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.917792] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.917928] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.918208] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.918356] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.918647] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.918817] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.918930] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.919164] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.919308] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.919452] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: f04ca19d-a94e-4453-8e47-fbaa9c096736 is going to be created. [ 1232.940019] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.940019] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.940019] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.940382] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.941177] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.941335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-f04ca19d-a94e-4453-8e47-fbaa9c096736" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.020875] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.134727] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.134945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.134945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.135242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.135359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.135465] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f is going to be updated. [ 1233.169405] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 in Status: SUCCESS [ 1233.169589] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 deletion is rescheduled due to dependency. [ 1233.169706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.177077] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.177269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.177269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.178040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.178040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.187529] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: IN_PROGRESS for 2s [ 1233.277278] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1233.277560] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 1233.277723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.523983] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.523983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.523983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.523983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.524547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.524547] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1233.558335] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.558496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.558533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.558733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.558880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.572359] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1233.735499] env[69756]: INFO networking_nsxv3.common.synchronization [req-979169fe-1715-4964-aa44-21ee861c60ab req-d9ea32cb-23ca-4a38-9954-d4a54030819b service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 1233.735809] env[69756]: INFO networking_nsxv3.common.synchronization [req-979169fe-1715-4964-aa44-21ee861c60ab req-d9ea32cb-23ca-4a38-9954-d4a54030819b service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1233.735809] env[69756]: INFO networking_nsxv3.common.synchronization [req-979169fe-1715-4964-aa44-21ee861c60ab req-d9ea32cb-23ca-4a38-9954-d4a54030819b service nova] Enqueued Resource ID: f04ca19d-a94e-4453-8e47-fbaa9c096736 with Priority: HIGHEST for action port [ 1233.736043] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 1233.736236] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1233.736376] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f04ca19d-a94e-4453-8e47-fbaa9c096736 with Priority: HIGHEST for action port [ 1233.736956] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.737208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.737299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.737542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.737649] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.738619] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.738752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.738994] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f04ca19d-a94e-4453-8e47-fbaa9c096736 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.739146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f04ca19d-a94e-4453-8e47-fbaa9c096736" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.739244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f04ca19d-a94e-4453-8e47-fbaa9c096736" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.739460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f04ca19d-a94e-4453-8e47-fbaa9c096736" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.739573] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f04ca19d-a94e-4453-8e47-fbaa9c096736',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.070292] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1234.070616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.071315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.071663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.071787] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.245507] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.245507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.245507] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f04ca19d-a94e-4453-8e47-fbaa9c096736 with status ACTIVE [ 1234.245507] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.245507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.245507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.253238] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.253238] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.253238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.253238] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f04ca19d-a94e-4453-8e47-fbaa9c096736 is going to be updated. [ 1234.280659] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.280908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.280988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.282750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.282893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.283172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f04ca19d-a94e-4453-8e47-fbaa9c096736" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.575398] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.575398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.575398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.575398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.575398] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.575398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.575398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.575795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.575795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.575795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.575795] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.078553] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.078553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.078553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.078553] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.079156] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.079156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.079156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.079156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.079156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.079633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.079633] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.079633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.079633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.079788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.080125] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.080125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.080363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.080363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.080363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.080521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.080521] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.198688] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: SUCCESS [ 1235.198911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.199135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.199418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.199649] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.199792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.199861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.200086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.200190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.200300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.200423] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.201399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.201569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.201730] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.201841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.201909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.202208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.202208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.202286] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.584936] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1235.584936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.584936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.584936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.584936] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.584936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.584936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.584936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.584936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.584936] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.587380] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6da75da-f8d6-4e54-8043-c3718b1492ed: rpc.has_security_group_logging(os_id): False [ 1235.609211] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.609211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.609211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.609211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.609211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.609211] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.609211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.609211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.609211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.609211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.609211] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.609211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.612824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.612824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.612824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.614160] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.614400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.614400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.614653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.614736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.614840] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1235.693480] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.693648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.693755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.695808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.695984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.703855] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.704059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.704296] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.713934] env[69756]: INFO networking_nsxv3.common.synchronization [req-4e49925b-4bed-4bb2-aeca-e2359ecb83fc req-a413d951-17ca-41be-9504-6e4b9988127f tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1235.714560] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1235.714933] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.716491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.716579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.716801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.716987] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.717130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.717202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.717378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.717523] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.717650] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.730247] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1235.975530] env[69756]: INFO networking_nsxv3.common.synchronization [req-60104a2b-024c-42ac-92d1-91f8587f483c req-64830eb1-cad4-4bd6-baaa-b9d3bad46dc3 tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1235.975816] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1235.976248] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.976395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.976469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.977028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.977028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.977207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.977207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.977378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.977461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.977578] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.087345] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.190522] env[69756]: INFO networking_nsxv3.common.synchronization [req-60104a2b-024c-42ac-92d1-91f8587f483c req-b6ed5281-7336-4cda-b800-d07e3d42e93d tempest-ServersTestMultiNic-1839425708 tempest-ServersTestMultiNic-1839425708-project-member] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1236.191947] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGHEST for action security_group_members [ 1236.192419] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.192520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.210341] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.221916] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.444410] env[69756]: INFO networking_nsxv3.common.synchronization [None req-cbcea1cb-7d1f-486b-a229-ab9269277392 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1236.444914] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1236.445236] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.445338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.479657] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.589447] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.712615] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.712811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.712894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.713202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.713289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.713433] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f is going to be updated. [ 1236.723544] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.747623] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.747830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.747877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.749024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.749024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.757914] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: IN_PROGRESS for 2s [ 1236.982154] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.092895] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.093301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.093301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.093385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.093569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.093709] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1237.122009] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.122312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.122418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.122647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.122798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.132031] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1237.226069] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.226263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.226313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.226565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.226676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.226801] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1237.266180] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.266340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.266411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.266621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.266767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.276092] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1237.484624] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.484951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.485050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.485356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.485520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.485681] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1237.521633] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.521633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.521852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.523020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.523020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.533522] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1237.763045] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1237.763045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.774163] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: SUCCESS [ 1238.774560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.774620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.774865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.775084] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.775203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.775403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.775624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.777024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.777024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.777024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.777024] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.145093] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 4s [ 1239.216802] env[69756]: INFO networking_nsxv3.common.synchronization [req-490bdd3b-d935-4346-b31d-379366a8849c req-d7e243a5-c7ba-4138-b5cd-dfc0897a2610 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_members [ 1239.217703] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGHEST for action security_group_members [ 1239.218218] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.218382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.218450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.218691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.218883] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.218990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.219068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.219226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.219317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.219428] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.278688] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ce25057-2acd-458d-b4eb-a7f4902ea73f: rpc.has_security_group_logging(os_id): False [ 1239.298679] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1239.298896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.299545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.299800] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.299950] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.300085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.300161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.300322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.300407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.300500] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.303630] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.303756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.303824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.304024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.304172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.304378] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.304499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.304630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.304705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.304783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.304969] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.305083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.305146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.305289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.305364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.305546] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.305638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.305700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.305839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.306112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.306112] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f is going to be created. [ 1239.385385] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.385564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.385564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.385811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.385957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.403232] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: IN_PROGRESS for 2s [ 1239.545482] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1239.545614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.545774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.545999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.546207] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.546602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.546602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.546602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.546784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.546852] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.722789] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.723086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.723196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.723486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.723785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.723785] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.723915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.723945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.724157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.724239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.724338] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 is going to be updated. [ 1239.756692] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.756860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.756913] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.757151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.757300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.768379] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 in Status: IN_PROGRESS for 2s [ 1239.804701] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.805050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.805050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.805264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.805361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.805561] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.805734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.805770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.805920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.806042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.806132] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1239.841130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.841130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.841130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.841130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.841130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.849630] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1240.049824] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.049988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.050077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.050332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.050428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.050628] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.050730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.050794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.050946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.051034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.051131] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be updated. [ 1240.081948] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.082303] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.082417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.082736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.086501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.097468] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: IN_PROGRESS for 2s [ 1241.172788] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1241.173170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.173170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.173393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.173703] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.174067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.174067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.174153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.174183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.174251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.174340] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.417610] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: SUCCESS [ 1241.417843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.418051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.418276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.418371] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.676212] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.676546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.676546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.676699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.676850] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.676940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.677034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.677177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.677286] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.677389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.677562] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.677642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.677701] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.677840] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.677977] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.678092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.678152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.678299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.678376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.678452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.678535] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.778912] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 in Status: SUCCESS [ 1241.780717] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 deletion is rescheduled due to dependency. [ 1241.780717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.862185] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1241.862465] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 deletion is rescheduled due to dependency. [ 1241.862550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.892553] env[69756]: INFO networking_nsxv3.common.synchronization [req-8ac0fd6e-ad10-496f-9c46-5708d0d5ea93 req-313cffe5-a033-4730-9788-1adb82de3e5e tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_members [ 1241.893101] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_members [ 1241.893513] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.893585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.894155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.897354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.897354] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.897354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.897354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.897354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.897600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.898235] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.920069] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.920265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.920343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.920551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.920752] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.920859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.920931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.921133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.921302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.922218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.922218] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.109588] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6da75da-f8d6-4e54-8043-c3718b1492ed in Status: SUCCESS [ 1242.109758] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed deletion is rescheduled due to dependency. [ 1242.109870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.180666] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8feed-cd04-49d0-9fbe-c89808cf758f: rpc.has_security_group_logging(os_id): False [ 1242.199499] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.199781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.199823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.200216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.200373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.200693] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.201793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.201793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.201793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.201793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.201793] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.201793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.201987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.202091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.202240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.206029] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.206029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.206029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.206029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.206029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.206029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1242.286632] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.286823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.286823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.287049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.287200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.313023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1242.364720] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.364934] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.365118] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.365354] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.365613] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.365771] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.365896] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.366212] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.366372] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.366587] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.366707] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1242.366823] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1242.366937] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1242.367060] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.367176] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1242.367314] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1242.391359] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1242.391537] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1242.391670] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1242.391900] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.392429] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-7a7472b2-9c79-43d0-85e6-f1d4a8032485 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.392645] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-7a7472b2-9c79-43d0-85e6-f1d4a8032485" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.392770] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-7a7472b2-9c79-43d0-85e6-f1d4a8032485" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.393124] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-7a7472b2-9c79-43d0-85e6-f1d4a8032485" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.393274] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a7472b2-9c79-43d0-85e6-f1d4a8032485',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.402010] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.402010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.402010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.402010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.402010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.402010] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.402010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.402010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.402010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.402010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.402010] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 already deleted. [ 1242.402010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.424385] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.424540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.424692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.424830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.425065] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.425311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.425365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.425550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.425641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.425730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.425875] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.425967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.426040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.426193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.426328] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.426439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.426545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.426736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.427337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.427337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.427337] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.896306] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.896610] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.896762] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.897078] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.897281] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.897411] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 7a7472b2-9c79-43d0-85e6-f1d4a8032485 not found, creating... [ 1242.897682] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.897846] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.897972] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.898225] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.898387] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.898674] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.898837] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.898962] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.899198] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.899367] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.899521] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 7a7472b2-9c79-43d0-85e6-f1d4a8032485 is going to be created. [ 1242.929390] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ce25057-2acd-458d-b4eb-a7f4902ea73f: rpc.has_security_group_logging(os_id): False [ 1242.981496] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.981496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.981496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.981756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.981915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.982343] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.982526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.982587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.982853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.982995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.983328] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.983495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.983603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.983832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.983961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.984270] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.984434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.984540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.984770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.984909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.985076] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f is going to be updated. [ 1242.993459] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.993752] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.993888] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.994204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.994446] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.994801] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-7a7472b2-9c79-43d0-85e6-f1d4a8032485" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.103821] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.103821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.103821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.104107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.104107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.142088] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: IN_PROGRESS for 2s [ 1243.715910] env[69756]: INFO networking_nsxv3.common.synchronization [req-8ac0fd6e-ad10-496f-9c46-5708d0d5ea93 req-51d6b454-9872-4eec-8ac9-aa4a7d6b156d service nova] Enqueued Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_rules [ 1243.716190] env[69756]: INFO networking_nsxv3.common.synchronization [req-8ac0fd6e-ad10-496f-9c46-5708d0d5ea93 req-51d6b454-9872-4eec-8ac9-aa4a7d6b156d service nova] Enqueued Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_members [ 1243.716275] env[69756]: INFO networking_nsxv3.common.synchronization [req-8ac0fd6e-ad10-496f-9c46-5708d0d5ea93 req-51d6b454-9872-4eec-8ac9-aa4a7d6b156d service nova] Enqueued Resource ID: 7a7472b2-9c79-43d0-85e6-f1d4a8032485 with Priority: HIGHEST for action port [ 1243.716483] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_rules [ 1243.716614] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_members [ 1243.716710] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7472b2-9c79-43d0-85e6-f1d4a8032485 with Priority: HIGHEST for action port [ 1243.717264] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.717381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.717501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.717678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.717760] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.720271] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.720384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.724061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.724061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.724061] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.724061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.724061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.724061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.724061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.724061] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.724061] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a7472b2-9c79-43d0-85e6-f1d4a8032485 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.724061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a7472b2-9c79-43d0-85e6-f1d4a8032485" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.724061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a7472b2-9c79-43d0-85e6-f1d4a8032485" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.724061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a7472b2-9c79-43d0-85e6-f1d4a8032485" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.724061] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a7472b2-9c79-43d0-85e6-f1d4a8032485',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.227082] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.227082] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.227082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.227082] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a7472b2-9c79-43d0-85e6-f1d4a8032485 with status ACTIVE [ 1244.227082] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.227082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.227082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.227082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.227082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.227082] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.227082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.227082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.227082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.227082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.227717] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.227717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.227717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.228111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.228378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.228615] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a7472b2-9c79-43d0-85e6-f1d4a8032485 is going to be updated. [ 1244.285993] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.285993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.285993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.285993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.285993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.285993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a7472b2-9c79-43d0-85e6-f1d4a8032485" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.336309] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1244.336578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.673063] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3516a3d-45c1-4f39-a860-921bc37e9faa req-5233f4d5-565d-44eb-9b56-de191cc9a681 tempest-ServerRescueTestJSON-402335687 tempest-ServerRescueTestJSON-402335687-project-member] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1244.673655] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1244.673981] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.674492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.674569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.675117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.675310] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.676072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.676173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.676371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.676461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.676565] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.731272] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.142355] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.142555] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-755" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.142555] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-755" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.143030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-755" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.143341] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.143581] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.143721] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.143980] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.144188] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.144460] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1245.144584] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1245.145378] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1245.145540] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1245.145860] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1245.145860] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1245.145961] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1245.164019] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: SUCCESS [ 1245.164329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.173191] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1245.173456] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1245.173630] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1245.173852] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-755" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.174477] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.174477] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.174732] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.175200] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.175200] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d7ed545-16ae-4e4c-96bc-a698c8930aa2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.179282] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.233576] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.233815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.233946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.234302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.234490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.234679] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 is going to be created. [ 1245.263792] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.263792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.263792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.264038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.264148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.276515] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 in Status: UNINITIALIZED for 2s [ 1245.678014] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.678353] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.678426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.678722] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.678882] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.679081] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 2d7ed545-16ae-4e4c-96bc-a698c8930aa2 not found, creating... [ 1245.679403] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.679572] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.679697] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.680018] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.680234] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.680550] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.680726] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.680867] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.681149] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.681324] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.681510] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 2d7ed545-16ae-4e4c-96bc-a698c8930aa2 is going to be created. [ 1245.682680] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.703036] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.703036] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.703278] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.703432] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.704047] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.704047] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.185122] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.185463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.185463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.185564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.186567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.186567] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e14423-20f6-4632-a776-83c92acbd98e is going to be updated. [ 1246.240200] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.240352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.240425] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.240645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.240794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.251257] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: IN_PROGRESS for 2s [ 1246.607624] env[69756]: INFO networking_nsxv3.common.synchronization [req-bd3d502d-691e-44c7-9e9c-9cd8906e81da req-df6b6abd-52b8-46cf-8b29-1bc0a7e6c3ae tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1246.608265] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1246.608587] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.608756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.608832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.609130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.609290] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.609394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.609455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.609605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.609690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.609782] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.673746] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3516a3d-45c1-4f39-a860-921bc37e9faa req-69b1f289-6233-48be-99d1-f114698667fa service nova] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_rules [ 1246.673930] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3516a3d-45c1-4f39-a860-921bc37e9faa req-69b1f289-6233-48be-99d1-f114698667fa service nova] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1246.674087] env[69756]: INFO networking_nsxv3.common.synchronization [req-f3516a3d-45c1-4f39-a860-921bc37e9faa req-69b1f289-6233-48be-99d1-f114698667fa service nova] Enqueued Resource ID: 2d7ed545-16ae-4e4c-96bc-a698c8930aa2 with Priority: HIGHEST for action port [ 1246.674624] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_rules [ 1246.674772] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1246.674867] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7ed545-16ae-4e4c-96bc-a698c8930aa2 with Priority: HIGHEST for action port [ 1246.675395] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.675511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.675654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.675851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.675946] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.676939] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.677029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.677275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.677399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.677468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.677674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.677754] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d7ed545-16ae-4e4c-96bc-a698c8930aa2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.111670] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.186070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.186070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.186070] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d7ed545-16ae-4e4c-96bc-a698c8930aa2 with status ACTIVE [ 1247.186070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.186070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.186070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.186070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.186070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.186070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.186070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.186070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.186070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.186070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.186070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.186893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.186893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.186893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.186893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.186893] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d7ed545-16ae-4e4c-96bc-a698c8930aa2 is going to be updated. [ 1247.209278] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.209462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.209538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.209758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.209898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.210095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d7ed545-16ae-4e4c-96bc-a698c8930aa2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.295370] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 in Status: SUCCESS [ 1247.295645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.295838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.297082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.297082] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.297082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.297082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.297082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.297082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.297082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.297082] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.614401] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.800206] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.117442] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.117582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.117631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.117895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.117962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.118210] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1248.188057] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.188363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.188363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.188440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.190020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.200405] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1248.274310] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: SUCCESS [ 1248.274577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.274732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.274918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.275116] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.275236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.275306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.275461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.275539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.275728] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.302250] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6eeacafc-9338-4b00-81ae-be5fbe3d68e7: rpc.has_security_group_logging(os_id): False [ 1248.327643] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.327907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.328783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.328783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.328783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.328783] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.328990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.328990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.329060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.329144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.330063] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 is going to be created. [ 1248.409964] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.410237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.410348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.413668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.413968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.426177] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 in Status: IN_PROGRESS for 2s [ 1248.779159] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.274124] env[69756]: INFO networking_nsxv3.common.synchronization [None req-4219d9b1-1667-4e47-9b94-dd84839ccc55 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_rules [ 1249.274765] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_rules [ 1249.275797] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.275797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.275797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.275797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.275797] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.285240] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.424777] env[69756]: INFO networking_nsxv3.common.synchronization [None req-4b79aea1-e0a7-4111-8599-ae23390b2b09 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_rules [ 1249.425862] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_rules [ 1249.426219] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.426328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.792224] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.792404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.792479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.792700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.792795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.792899] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e14423-20f6-4632-a776-83c92acbd98e is going to be updated. [ 1249.798667] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.798964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.798964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.800168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.800168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.800168] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 already deleted. [ 1249.800168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.800168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.800168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.800168] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.827344] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.827496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.827567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.827790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.827941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.839271] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: IN_PROGRESS for 2s [ 1250.099418] env[69756]: INFO networking_nsxv3.common.synchronization [req-197c424d-b21f-4f8d-8659-140a2509691d req-85891830-6900-4590-9633-47ba38f1d4c7 tempest-AttachVolumeTestJSON-1233597287 tempest-AttachVolumeTestJSON-1233597287-project-member] Enqueued Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_members [ 1250.100103] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGHEST for action security_group_members [ 1250.100977] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-30452e03-76c9-417a-95b9-4a5e9c875fe6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.100977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.100977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.100977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.108106] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.108106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.108106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.108106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.108106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.108106] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.218754] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1250.218990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.330644] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.330644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.330644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.330644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.330644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.330644] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 already deleted. [ 1250.330644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.454909] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 in Status: SUCCESS [ 1250.455192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.610542] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.610542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.610542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.610542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.610696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.610853] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.610982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.611075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.611240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.611335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.611409] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 is going to be updated. [ 1250.649287] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.649532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.649637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.649943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.650195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.666497] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 in Status: IN_PROGRESS for 2s [ 1250.781610] env[69756]: INFO networking_nsxv3.common.synchronization [req-60ce0465-a331-4a36-afe5-0e8df39552b8 req-504d7e6f-f98b-4aca-9b9f-a0936b981e38 tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1250.781889] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1250.782090] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.782235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.782304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.782504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.782658] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.782744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.782806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.782954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.783761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.783896] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.290039] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.290620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.290620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.290620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.290620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.290799] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.291124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.291124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.291124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.291302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.291302] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1251.335391] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.335391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.335391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.335759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.335870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.349456] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1251.357608] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.357864] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.358101] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.358624] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.358967] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.359167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.359300] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.359536] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.359694] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.359983] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.360233] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.360390] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.360535] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.360667] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.360783] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.360969] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.385529] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.385529] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1251.385529] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.385529] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.385722] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-10abc944-153e-4717-a0df-ba784fc0192a taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.385854] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-10abc944-153e-4717-a0df-ba784fc0192a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.386035] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-10abc944-153e-4717-a0df-ba784fc0192a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.386451] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-10abc944-153e-4717-a0df-ba784fc0192a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.386871] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10abc944-153e-4717-a0df-ba784fc0192a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.447217] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.447395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.447434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.447850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.447850] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.850747] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: SUCCESS [ 1251.850986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.851284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.851409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.851598] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.851717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.851783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.851932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.852020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.852304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.852304] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.893862] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.893862] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.893862] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.893862] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.893862] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.893862] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 10abc944-153e-4717-a0df-ba784fc0192a not found, creating... [ 1251.893862] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.893862] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.893862] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.894432] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.894432] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.894618] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.894788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.894911] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.895283] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.895437] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.895601] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 10abc944-153e-4717-a0df-ba784fc0192a is going to be created. [ 1251.924073] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.924073] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.924310] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.924830] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.924830] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.925045] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-10abc944-153e-4717-a0df-ba784fc0192a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.950289] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.356338] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.356338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.356338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.356338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.356338] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.356338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.356338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.356338] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.356841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.356841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.356841] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.356841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.356841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.356981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.358046] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.358046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.358046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.358046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.358046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.358046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.358046] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.453738] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.697682] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 in Status: SUCCESS [ 1252.697844] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 deletion is rescheduled due to dependency. [ 1252.697974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.807329] env[69756]: INFO networking_nsxv3.common.synchronization [req-60ce0465-a331-4a36-afe5-0e8df39552b8 req-9cc2c9d4-0719-4b64-a02f-853a0a5247bd service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 1252.807624] env[69756]: INFO networking_nsxv3.common.synchronization [req-60ce0465-a331-4a36-afe5-0e8df39552b8 req-9cc2c9d4-0719-4b64-a02f-853a0a5247bd service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1252.807791] env[69756]: INFO networking_nsxv3.common.synchronization [req-60ce0465-a331-4a36-afe5-0e8df39552b8 req-9cc2c9d4-0719-4b64-a02f-853a0a5247bd service nova] Enqueued Resource ID: 10abc944-153e-4717-a0df-ba784fc0192a with Priority: HIGHEST for action port [ 1252.808683] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 1252.808831] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1252.808937] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10abc944-153e-4717-a0df-ba784fc0192a with Priority: HIGHEST for action port [ 1252.809405] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.809602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.809732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.810013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.810145] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.811998] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.812309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.812653] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-10abc944-153e-4717-a0df-ba784fc0192a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.812871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10abc944-153e-4717-a0df-ba784fc0192a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.812944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10abc944-153e-4717-a0df-ba784fc0192a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.813262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10abc944-153e-4717-a0df-ba784fc0192a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.813377] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10abc944-153e-4717-a0df-ba784fc0192a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.862053] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6e14423-20f6-4632-a776-83c92acbd98e: rpc.has_security_group_logging(os_id): False [ 1252.889025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.889025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.889025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.889025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.889681] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.889681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.891095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.891957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.892253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.893091] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e14423-20f6-4632-a776-83c92acbd98e is going to be updated. [ 1252.956452] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1252.957758] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1253.011576] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.011750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.011808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.012020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.012173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.043747] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: IN_PROGRESS for 2s [ 1253.316033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.316201] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.316433] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10abc944-153e-4717-a0df-ba784fc0192a with status ACTIVE [ 1253.316622] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.316752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.316818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.317070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.317172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.317377] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.317491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.317562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.317776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.317882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.318100] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.318193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.318251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.318397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.318491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.318577] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10abc944-153e-4717-a0df-ba784fc0192a is going to be updated. [ 1253.325753] env[69756]: INFO networking_nsxv3.common.synchronization [req-d5e63fd3-51ae-452f-8a96-d4ed5f013bc0 req-61116f4c-44b9-46b9-80cd-737274899d77 tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 1253.326979] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 1253.327500] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.327635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.327706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.327928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.329107] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.329107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.329107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.329107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.329107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.329107] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.390832] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1253.391333] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 1253.391333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.391333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.391702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.391805] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.391922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.391994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.392262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.393049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.393049] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.394766] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.394766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.394766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.394766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.395239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.395239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10abc944-153e-4717-a0df-ba784fc0192a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.832918] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.833215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.833304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.833620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.833783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.834208] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.834310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.834366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.834675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.834807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.834971] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 is going to be deleted. [ 1253.897561] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.905822] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.905997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.906100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.906371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.906535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.907259] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.319138] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.319350] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.319476] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.319828] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.320869] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.320869] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.320869] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.320869] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.320869] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.321494] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.321494] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.321494] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.321494] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.321776] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.321776] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.321776] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.395209] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.395562] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.074 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1254.395562] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.395690] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.396042] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-c46a4f35-1fde-4479-9581-1ff7b201a9b3 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.396263] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.396580] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.396749] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.396899] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c46a4f35-1fde-4479-9581-1ff7b201a9b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.399609] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.790797] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.790968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.791084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.791295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.805982] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1254.807142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.808455] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1254.848597] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.848754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.848826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.849073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.861078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.861810] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1254.861896] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1254.861993] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1254.899939] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.900402] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.900596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.900928] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.901132] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.901305] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port c46a4f35-1fde-4479-9581-1ff7b201a9b3 not found, creating... [ 1254.901770] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.902083] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.902346] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.903066] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.903066] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.903402] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.903705] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.904335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.904428] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.904622] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.904871] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: c46a4f35-1fde-4479-9581-1ff7b201a9b3 is going to be created. [ 1254.906323] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.906551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.906648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.906849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.906931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.907040] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1254.949794] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.950153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.950257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.950495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.953025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.953410] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1254.956147] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.956453] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.956663] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.957164] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.957551] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.957941] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.991575] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.991575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.991747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.991986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.992220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.004386] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1255.061236] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: SUCCESS [ 1255.061236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.190523] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.192098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.192098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.192098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.192098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.192335] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1255.314405] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.314908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.316018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.317028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.317028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.317740] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1255.318102] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'77f0576f-4cd5-4be0-a66d-6284578fd001', '85a485c2-7c41-4a10-ae35-986ad49897e2', 'a55f513a-b24f-43aa-8d5c-60a35c3553a1', '30452e03-76c9-417a-95b9-4a5e9c875fe6', '17111ea1-decc-4289-b6f5-8ab312a62032', 'b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf', '3abf8d34-b1bf-4948-b5ca-6ddaf615a162', '30b64bbe-dc6f-49e2-8ffb-8b4a312e2734', '28a1544a-4fd5-4e41-87b3-73a71a6e4689', 'cced9593-3500-4c12-99da-d35935a142b3', '47f4cc8e-dc8b-42c2-a280-bec009884679', '58d8feed-cd04-49d0-9fbe-c89808cf758f', '48c09f21-41e5-4def-8d66-8a36711be55a', '1ce25057-2acd-458d-b4eb-a7f4902ea73f', 'f6da75da-f8d6-4e54-8043-c3718b1492ed', '2e24a162-f28e-4e20-8805-9798b600cdda', '6eeacafc-9338-4b00-81ae-be5fbe3d68e7', '3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8', 'b6e14423-20f6-4632-a776-83c92acbd98e', 'd8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc', '4d9269ab-57a3-474d-a98c-7ba1583e57fc', 'f601c152-eb22-420e-b5ef-b628b6976a70', '32c981c7-b7d3-4add-9b02-8a36551527e8', '85796156-67df-4d82-b494-0ea64303f9ba', '285c5000-ac60-42b0-8441-f857f98438d0', 'fa5dd68d-835d-4416-ac9f-cab1591b2b82', 'bdf28d13-db76-40d0-a00d-750f9a74b1d7', '6c2c5148-c58a-4fc6-be42-8d4236e7fbb5', '7fd17e7b-8910-4529-a801-b80ed3d29a0e', 'b7abf7f6-a856-4157-be54-ef99b007674f', '77ecb29c-d932-487b-b95d-59676b2a2f50', '8e923000-de4f-4614-8d9f-829896824884', '73cf7e80-866c-4475-93d6-8e9e3254cf79', '70b83947-df81-4c26-945b-c5d14986de4a', '7d711ed5-98da-4810-9f03-9148ad645008', '49317fc3-59c5-4b8b-a14b-79b0c266a17a', 'dd71eef3-fdb4-4293-8cf4-077891626874', '9e669f6b-9b7b-497e-9670-1ddbd9860754', '790cacf0-2ff7-4926-9b9d-c3a421bdf3b0', 'f76720d0-5804-46fa-8a2f-21842f720546', '8de5d68d-6838-4955-ae71-d9dd48c0a125', '91d49c48-1e8f-4b77-9b74-b8d508a2115b', 'b5f631a6-10e1-4423-9d64-92e1be795a21', '4b6578e8-a78e-4c09-82f2-a7faaacca9bc', 'a6688165-9289-4b4f-a688-1379d300b9cd', '4cae8dc5-dcca-4592-aebe-26bb46462d80', '3669143c-24cd-4014-976c-a88fbc9ce9be'} {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1255.320532] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1255.348978] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.348978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.348978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.348978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.348978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.348978] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1255.348978] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1255.348978] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1255.470229] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.470229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.470229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.471437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.474760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.474760] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1255.474760] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1255.474760] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1255.474760] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1255.474760] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGH for action security_group_rules [ 1255.474760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.653524] env[69756]: INFO networking_nsxv3.common.synchronization [req-d5e63fd3-51ae-452f-8a96-d4ed5f013bc0 req-9781318c-cfb7-4a5c-9208-df9d65840b4a service nova] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_rules [ 1255.653799] env[69756]: INFO networking_nsxv3.common.synchronization [req-d5e63fd3-51ae-452f-8a96-d4ed5f013bc0 req-9781318c-cfb7-4a5c-9208-df9d65840b4a service nova] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 1255.653921] env[69756]: INFO networking_nsxv3.common.synchronization [req-d5e63fd3-51ae-452f-8a96-d4ed5f013bc0 req-9781318c-cfb7-4a5c-9208-df9d65840b4a service nova] Enqueued Resource ID: c46a4f35-1fde-4479-9581-1ff7b201a9b3 with Priority: HIGHEST for action port [ 1255.654065] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_rules [ 1255.654204] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 1255.654311] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c46a4f35-1fde-4479-9581-1ff7b201a9b3 with Priority: HIGHEST for action port [ 1255.654750] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 with Priority: HIGH for action security_group_rules [ 1255.655021] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGH for action security_group_rules [ 1255.655021] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 with Priority: HIGH for action security_group_rules [ 1255.655021] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6da75da-f8d6-4e54-8043-c3718b1492ed with Priority: HIGH for action security_group_rules [ 1255.655213] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGH for action security_group_rules [ 1255.655213] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGH for action security_group_rules [ 1255.655512] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGH for action security_group_rules [ 1255.655641] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGH for action security_group_rules [ 1255.655734] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGH for action security_group_rules [ 1255.655823] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e24a162-f28e-4e20-8805-9798b600cdda with Priority: HIGH for action security_group_rules [ 1255.655912] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09f21-41e5-4def-8d66-8a36711be55a with Priority: HIGH for action security_group_rules [ 1255.656020] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGH for action security_group_rules [ 1255.656105] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 with Priority: HIGH for action security_group_rules [ 1255.656196] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9593-3500-4c12-99da-d35935a142b3 with Priority: HIGH for action security_group_rules [ 1255.656296] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 with Priority: HIGH for action security_group_rules [ 1255.656451] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf with Priority: HIGH for action security_group_rules [ 1255.656451] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 with Priority: HIGH for action security_group_rules [ 1255.656523] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17111ea1-decc-4289-b6f5-8ab312a62032 with Priority: HIGH for action security_group_rules [ 1255.656609] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 with Priority: HIGH for action security_group_rules [ 1255.656648] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 with Priority: HIGH for action security_group_rules [ 1255.657359] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.657493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.657558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.657775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.657931] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.658838] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.658957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.659035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.659216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.659364] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.659458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.659514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.659654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.659736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.659825] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.660966] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c46a4f35-1fde-4479-9581-1ff7b201a9b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.661091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.661179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.661620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.661620] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c46a4f35-1fde-4479-9581-1ff7b201a9b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.662446] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77f0576f-4cd5-4be0-a66d-6284578fd001 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.662643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.662643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.662801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.662801] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77f0576f-4cd5-4be0-a66d-6284578fd001',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.663550] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.663657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.663706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.663855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.663928] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.667581] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.667581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.667581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.667581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.667581] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3abf8d34-b1bf-4948-b5ca-6ddaf615a162',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.667581] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6da75da-f8d6-4e54-8043-c3718b1492ed taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.667581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.667581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.667581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.667581] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6da75da-f8d6-4e54-8043-c3718b1492ed',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.667581] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.667581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.667581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.667581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.667581] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.668413] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.668413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.668413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.668413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.668576] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.669162] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.669264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.669341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.669663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.669663] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.670514] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.670640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.670699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.670825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.670900] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.671601] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.671722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.671796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.671970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.675027] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.675027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e24a162-f28e-4e20-8805-9798b600cdda taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.675027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.675027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.675027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.675027] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e24a162-f28e-4e20-8805-9798b600cdda',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.675027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c09f21-41e5-4def-8d66-8a36711be55a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.675027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.675027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.675027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.675027] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c09f21-41e5-4def-8d66-8a36711be55a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.675027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.675635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.675635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.676283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.676283] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.676660] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f4cc8e-dc8b-42c2-a280-bec009884679 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.676796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.676881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.677036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.677139] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f4cc8e-dc8b-42c2-a280-bec009884679',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.678154] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cced9593-3500-4c12-99da-d35935a142b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.678154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.678154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.678429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.678492] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cced9593-3500-4c12-99da-d35935a142b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.679301] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.679667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.679804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.679995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.680130] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a1544a-4fd5-4e41-87b3-73a71a6e4689',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.680932] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.681085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.681147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.681355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.681488] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.682591] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.682716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.682771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.682890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.683063] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b64bbe-dc6f-49e2-8ffb-8b4a312e2734',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.683830] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17111ea1-decc-4289-b6f5-8ab312a62032 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.683967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.684070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.684250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.684350] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17111ea1-decc-4289-b6f5-8ab312a62032',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.800134] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85a485c2-7c41-4a10-ae35-986ad49897e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.800134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.800134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.800134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.800134] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85a485c2-7c41-4a10-ae35-986ad49897e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.800134] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30452e03-76c9-417a-95b9-4a5e9c875fe6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.800134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.800134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.800134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.800134] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30452e03-76c9-417a-95b9-4a5e9c875fe6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.190910] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.191135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.193029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c46a4f35-1fde-4479-9581-1ff7b201a9b3 with status ACTIVE [ 1256.193252] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.193408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.193475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.193694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.193787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.193970] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.194088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.194148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.194319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.194401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.194588] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.194706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.194804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.194880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.194930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.195025] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c46a4f35-1fde-4479-9581-1ff7b201a9b3 is going to be updated. [ 1256.196077] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.198266] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.198409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.198454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.198611] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.198758] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.198858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.198906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.199064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.199137] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.199219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.199317] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.200559] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.200680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.200745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.201129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.201129] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.201129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.201365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.201365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.201428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.201551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.201593] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.238986] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.239165] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.239240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.239536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.241848] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.241985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.251289] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.251660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.251660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.251928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.251990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.252436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.253680] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.253868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.270140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.270348] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6da75da-f8d6-4e54-8043-c3718b1492ed is going to be deleted. [ 1256.271349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.271586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.303487] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.303754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.303916] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.304174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.304359] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.305370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.305525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.305747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.305871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.305936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.306028] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.307077] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.307233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.307294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.307419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.307571] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.307667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.307735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.307876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.307958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.308046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.308127] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.310275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.310410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.310515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.310796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.310964] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.311098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.311144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.311298] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.311384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.311473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.311582] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.313160] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.313268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.313268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.313653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.313653] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.313816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.313816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.313952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.314056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.314167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.314258] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.316599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.316713] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3abf8d34-b1bf-4948-b5ca-6ddaf615a162 is going to be deleted. [ 1256.319654] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.319820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.319985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.320073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.320260] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.320661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.320661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.320661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.320796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.320796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.320867] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.326621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.326771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.332430] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.332628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.332735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.333048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.333631] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.333805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.333878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.334101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.334170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.334260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.334424] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.334518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.334579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.334740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.334885] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.335051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.335051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.335178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.335258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.335368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.335463] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.391816] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.392021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.402263] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.402462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.403975] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.404174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.405141] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.405252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.406103] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.406190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.407426] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.407426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.408154] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.408154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.408868] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.408954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.409658] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.409760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.433139] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.433350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.443655] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1256.444265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.444404] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77f0576f-4cd5-4be0-a66d-6284578fd001 is going to be deleted. [ 1256.445676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.445914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.462641] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.462841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.481149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.481149] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f4cc8e-dc8b-42c2-a280-bec009884679 is going to be deleted. [ 1256.482796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.482796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.529858] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.529858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.537033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.537191] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17111ea1-decc-4289-b6f5-8ab312a62032 is going to be deleted. [ 1256.538144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.538379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.627106] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.627298] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.641150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.641309] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30452e03-76c9-417a-95b9-4a5e9c875fe6 is going to be deleted. [ 1256.642283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.642538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.680629] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.680629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.694279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.694279] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a1544a-4fd5-4e41-87b3-73a71a6e4689 is going to be deleted. [ 1256.695738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.696108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.701112] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.704151] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.705111] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.767126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.767349] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cced9593-3500-4c12-99da-d35935a142b3 is going to be deleted. [ 1256.768258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.768756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.814065] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.814245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.814321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.814545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.814716] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.814814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.814878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.815289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.815289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.815289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.815455] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.815455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.815531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.815637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.815770] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.815860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.815920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.816074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.816151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.816261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.816368] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.817429] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.817582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.817614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.817768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.817908] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.818013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.818085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.818225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.818306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.818390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.818627] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.818720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.818817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.818911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.819063] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.819157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.819219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.819359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.819434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.819515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.819937] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.820739] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.820937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.821047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.821216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.821352] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.821466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.821534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.821710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.821762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.821851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.821991] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.822099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.822161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.822484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.822640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.822736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.822798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.822941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.823024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.823110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.823248] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.828415] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.838346] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8feed-cd04-49d0-9fbe-c89808cf758f: rpc.has_security_group_logging(os_id): False [ 1256.843874] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.843967] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.847418] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.847577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.854988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.855161] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b64bbe-dc6f-49e2-8ffb-8b4a312e2734 is going to be deleted. [ 1256.856591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.856877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.890929] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.891124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.894714] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.894953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.905039] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.905180] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85a485c2-7c41-4a10-ae35-986ad49897e2 is going to be deleted. [ 1256.906459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.906685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.984279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.984450] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf is going to be deleted. [ 1256.985417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.985664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.039519] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1257.039519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.039519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.039780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.039957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.040092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.040163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.040429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.040517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.040603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.040695] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.075394] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.075572] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e24a162-f28e-4e20-8805-9798b600cdda is going to be deleted. [ 1257.077102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.077346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.124649] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.124824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.125964] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.126104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.164898] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.164898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.180880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.181054] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c09f21-41e5-4def-8d66-8a36711be55a is going to be deleted. [ 1257.183008] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.183251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.183329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.183486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6da75da-f8d6-4e54-8043-c3718b1492ed" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.183667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.183834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.183914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.184080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3abf8d34-b1bf-4948-b5ca-6ddaf615a162" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.184706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.184885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.184996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.185107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77f0576f-4cd5-4be0-a66d-6284578fd001" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.186765] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.186958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.187073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.187255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.187361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.187472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1290057-b1f2-4a4e-99e5-3ee3e29f4cbf" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.187614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.187772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.187853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.188139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f4cc8e-dc8b-42c2-a280-bec009884679" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.188139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.188284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.189598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.189598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17111ea1-decc-4289-b6f5-8ab312a62032" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.189598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.189598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.189598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.189598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30452e03-76c9-417a-95b9-4a5e9c875fe6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.190073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.190073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.190073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.190073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a1544a-4fd5-4e41-87b3-73a71a6e4689" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.190486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.190639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.203780] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.204117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.204708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.204708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.204708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.204952] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 is going to be created. [ 1257.207110] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc: rpc.has_security_group_logging(os_id): False [ 1257.209060] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a55f513a-b24f-43aa-8d5c-60a35c3553a1: rpc.has_security_group_logging(os_id): False [ 1257.279640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.279640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.282145] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.282145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.302099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.302099] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.302099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.302099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.302293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.302402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.302734] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.302917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.303041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.303313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.304476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.304476] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.304476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.304476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.304476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.304476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.304861] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1257.306710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.306799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.307616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.307616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cced9593-3500-4c12-99da-d35935a142b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.307616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.307616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.307616] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.307927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85a485c2-7c41-4a10-ae35-986ad49897e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.307963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.308587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.308587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.308587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b64bbe-dc6f-49e2-8ffb-8b4a312e2734" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.308680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.308844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.328961] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ce25057-2acd-458d-b4eb-a7f4902ea73f: rpc.has_security_group_logging(os_id): False [ 1257.330161] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6e14423-20f6-4632-a776-83c92acbd98e: rpc.has_security_group_logging(os_id): False [ 1257.331041] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8: rpc.has_security_group_logging(os_id): False [ 1257.332793] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.332943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.333149] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6eeacafc-9338-4b00-81ae-be5fbe3d68e7: rpc.has_security_group_logging(os_id): False [ 1257.427050] env[69756]: INFO networking_nsxv3.common.synchronization [None req-d8ae7589-75c6-4a67-b171-dbcffcf32161 tempest-AttachVolumeTestJSON-1233597287 tempest-AttachVolumeTestJSON-1233597287-project-member] Enqueued Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_rules [ 1257.427735] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_rules [ 1257.428588] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.428746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.428815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.429100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.429186] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.472084] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.472084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.472364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.472584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.472804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.488766] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.489306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.490013] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.490163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.491081] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.491208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.496580] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.496793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.525902] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.526348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.528643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.528924] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.529026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.529099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.529363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.529458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.529561] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1257.530880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.531734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.534191] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: UNINITIALIZED for 2s [ 1257.546404] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.546585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.546672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.546954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.547170] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.547294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.547365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.547599] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.547699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.547811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.548009] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.548167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.548243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.548442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.548602] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.548739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.548939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.549289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.549520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.549724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.549911] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.602381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.602698] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.602794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.602868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.603090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.603178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.603487] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 is going to be updated. [ 1257.604727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.604944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.669025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.669025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.669025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.669025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.669025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.669025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.669025] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 is going to be updated. [ 1257.669025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.669025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.710953] env[69756]: INFO networking_nsxv3.common.synchronization [None req-2a6bbfb9-6d0c-46d1-8cc3-d7a36530cbaf tempest-AttachVolumeTestJSON-1233597287 tempest-AttachVolumeTestJSON-1233597287-project-member] Enqueued Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_rules [ 1257.710953] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_rules [ 1257.711722] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.712257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.726041] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.726041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.726041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.726041] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.726041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.726041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.727193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.727503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.727979] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.728269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.728448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.731161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.731161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.731161] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.731161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.731161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.731161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.731161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.731161] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1257.731161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.731604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.731775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.731985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c09f21-41e5-4def-8d66-8a36711be55a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.732637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.733040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.733302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.733531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e24a162-f28e-4e20-8805-9798b600cdda" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.733785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.734043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.777026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.777026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.777026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.777026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.778436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.778436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.778436] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f is going to be updated. [ 1257.779250] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.779485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.779664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.780878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.781389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.838638] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1257.853789] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.853789] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.854070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.854191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.854472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.854626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.855237] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.856964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.856964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.856964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.856964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.856964] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.856964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.856964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.856964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.856964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.856964] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e14423-20f6-4632-a776-83c92acbd98e is going to be updated. [ 1257.901468] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.901678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.901771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.902092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.902390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.915213] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.915551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.915794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.916430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.916430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.928181] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.928380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.929097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.930657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.930986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.956056] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 in Status: IN_PROGRESS for 2s [ 1257.969036] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1258.014028] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.014028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.014028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.014028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.014028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.048805] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1258.052889] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d711ed5-98da-4810-9f03-9148ad645008: rpc.has_security_group_logging(os_id): False [ 1258.057998] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.057998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.057998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.057998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.058361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.058361] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 already deleted. [ 1258.058361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.058463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.058572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.058656] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.077999] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.078238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.078295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.078540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.078704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.090300] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 in Status: IN_PROGRESS for 2s [ 1258.110414] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.110618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.110664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.110895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.114313] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: IN_PROGRESS for 2s [ 1258.192706] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1258.193188] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.193427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.228633] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1258.229431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.229866] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.230082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.230211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.230528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.230667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.231095] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.231269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.231368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.231630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.231746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.232066] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.232280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.232395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.232653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.232795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.232916] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1258.234636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.234918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.235159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.288904] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: IN_PROGRESS for 2s [ 1258.457153] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.457153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.457153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.457153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.457153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.474862] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1258.599960] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.599960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.599960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.599960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.599960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.599960] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 already deleted. [ 1258.599960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.488508] env[69756]: INFO networking_nsxv3.common.synchronization [req-418e8f7c-bf4b-4097-a5ea-bd1659276edc req-2c9e7de3-f3e8-4109-921c-c84447ae84b1 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1259.488508] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1259.488508] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.488508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.488508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.488962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.489334] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.489584] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.489767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.490088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.490527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.490801] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.553673] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: SUCCESS [ 1259.553946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.554143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.554369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.554559] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.554672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.554734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.554889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.555012] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.555159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.555258] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.856364] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1259.856364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.883045] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.883045] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.883045] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.883294] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.883571] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.883889] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.884347] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.884839] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.885165] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.885489] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.885684] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.885852] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.886031] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.886215] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.886410] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.886623] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.910985] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.911176] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1259.911332] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.911520] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.911856] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.912127] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.912293] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.912671] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.912822] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf3ef12-3e11-4875-83da-56ce19c9b0e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.971861] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 in Status: SUCCESS [ 1259.971861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.985911] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1259.986227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.993976] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.994193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.994260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.994519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.994692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.994902] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.994997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.995065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.995234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.995314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.995398] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 already deleted. [ 1259.995481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.059316] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.059711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.059831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.060105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.060365] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.060602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.060602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.060847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.060891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.061059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.061231] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.061325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.061413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.061536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.061682] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.061839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.061894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.062111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.062260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.062476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.062549] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.068405] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1260.068903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.124644] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 in Status: SUCCESS [ 1260.125027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.140427] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: SUCCESS [ 1260.140812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.306968] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: SUCCESS [ 1260.307158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.417833] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.418145] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.418209] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.418499] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.418699] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.418905] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 5bf3ef12-3e11-4875-83da-56ce19c9b0e2 not found, creating... [ 1260.419192] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.419392] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.419538] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.419785] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.419930] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.420260] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.420436] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.420558] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.420777] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.421299] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.421299] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 5bf3ef12-3e11-4875-83da-56ce19c9b0e2 is going to be created. [ 1260.443503] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.443741] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.443854] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.444184] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.444755] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.445135] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.514655] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1260.514934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.566264] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 867f2d31-4611-4fd9-ab17-4761f9cc8675: rpc.has_security_group_logging(os_id): False [ 1260.585533] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.585729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.585798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.585971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.586078] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.586268] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.586369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.586434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.586593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.586671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.586906] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.587016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.587084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.587234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.587311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.587490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.587585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.587647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.587785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.587859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.587945] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 is going to be created. [ 1260.684167] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.684392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.684392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.684635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.684839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.707874] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: IN_PROGRESS for 2s [ 1261.155883] env[69756]: INFO networking_nsxv3.common.synchronization [req-418e8f7c-bf4b-4097-a5ea-bd1659276edc req-9cd3c7a0-ddda-4211-b4f3-a52e7facc517 service nova] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_rules [ 1261.155883] env[69756]: INFO networking_nsxv3.common.synchronization [req-418e8f7c-bf4b-4097-a5ea-bd1659276edc req-9cd3c7a0-ddda-4211-b4f3-a52e7facc517 service nova] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1261.156277] env[69756]: INFO networking_nsxv3.common.synchronization [req-418e8f7c-bf4b-4097-a5ea-bd1659276edc req-9cd3c7a0-ddda-4211-b4f3-a52e7facc517 service nova] Enqueued Resource ID: 5bf3ef12-3e11-4875-83da-56ce19c9b0e2 with Priority: HIGHEST for action port [ 1261.156277] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_rules [ 1261.156344] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1261.156543] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf3ef12-3e11-4875-83da-56ce19c9b0e2 with Priority: HIGHEST for action port [ 1261.158306] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.158474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.158541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.158766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.158863] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.161170] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.161315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.161382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.162107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.162107] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.162107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.162107] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.162368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.162368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.162505] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.164066] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.164233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.164422] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.164668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.164781] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf3ef12-3e11-4875-83da-56ce19c9b0e2',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.664921] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.666636] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.666749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.666983] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bf3ef12-3e11-4875-83da-56ce19c9b0e2 with status ACTIVE [ 1261.667155] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.667263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.667330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.667545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.667649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.667822] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.667918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.667981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.668150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.668227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.668403] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.668499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.668561] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.668702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.668776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.668859] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bf3ef12-3e11-4875-83da-56ce19c9b0e2 is going to be updated. [ 1261.712757] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.712999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.713093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.713440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.713615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.713790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bf3ef12-3e11-4875-83da-56ce19c9b0e2" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.168214] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.671018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.671252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.671317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.671593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.671727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.671839] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 is going to be created. [ 1262.706378] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.706560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.706602] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.707976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.707976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.726779] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: UNINITIALIZED for 2s [ 1262.730607] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: SUCCESS [ 1262.730859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.430222] env[69756]: INFO networking_nsxv3.common.synchronization [req-caf81999-2052-4f6f-a395-b280bb2022e4 req-49b66793-a00e-4dd4-bf81-7e0a38cf4fbc tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1264.430825] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1264.432502] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.432674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.432782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.433061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.434537] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.434928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.434928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.435285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.435455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.435646] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.740584] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: SUCCESS [ 1264.740776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.741143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.741378] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.741579] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.741765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.741842] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.742054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.742146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.742451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.742594] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.853834] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.854090] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.854206] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.854516] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.854784] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.854950] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.855287] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.855600] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.855821] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.856139] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1264.856332] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1264.856504] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1264.856666] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1264.856838] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1264.857431] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1264.857770] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1264.880466] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1264.880647] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1264.880816] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1264.880978] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-37" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.881330] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-33315e30-9c20-478f-8174-66f12465172c taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.881514] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-33315e30-9c20-478f-8174-66f12465172c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.881655] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-33315e30-9c20-478f-8174-66f12465172c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.882655] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-33315e30-9c20-478f-8174-66f12465172c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.883305] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33315e30-9c20-478f-8174-66f12465172c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.941145] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.135106] env[69756]: INFO networking_nsxv3.common.synchronization [req-a943a6a4-e7dd-41d8-b49d-bf0fb0facad3 req-772fe5b2-439d-478f-bfde-b15f36ad52ba tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 1265.139024] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGHEST for action security_group_members [ 1265.139024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.139024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.139024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.139024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.139024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.139024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.139024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.139024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.139024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.139024] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.218398] env[69756]: INFO networking_nsxv3.common.synchronization [req-a943a6a4-e7dd-41d8-b49d-bf0fb0facad3 req-772fe5b2-439d-478f-bfde-b15f36ad52ba tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: c46a4f35-1fde-4479-9581-1ff7b201a9b3 with Priority: HIGHEST for action port [ 1265.219118] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c46a4f35-1fde-4479-9581-1ff7b201a9b3 with Priority: HIGHEST for action port [ 1265.219440] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c46a4f35-1fde-4479-9581-1ff7b201a9b3 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.219570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.219639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.219850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.221254] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c46a4f35-1fde-4479-9581-1ff7b201a9b3',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.245679] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.263843] env[69756]: INFO networking_nsxv3.common.synchronization [req-feadd80e-ae2e-4dae-a06b-6ff3e01940eb req-9c432b0d-5292-4eaa-8a45-14d281fb65c5 tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1265.264388] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1265.264739] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.264870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.264949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.265225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.269027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.269027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.269027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.269027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.269027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.269027] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.388337] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.388653] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.388749] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.389203] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.389494] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.389836] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 33315e30-9c20-478f-8174-66f12465172c not found, creating... [ 1265.390275] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.390565] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.390796] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.391345] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.391345] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.391718] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.391959] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.392112] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.392463] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.392626] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.392785] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 33315e30-9c20-478f-8174-66f12465172c is going to be created. [ 1265.417485] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.417793] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.417982] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.418396] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.418735] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.419083] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-33315e30-9c20-478f-8174-66f12465172c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.447044] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.641369] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.641546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.641636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.641860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.642090] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.642180] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.642277] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.642357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.642592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.642714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.642830] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 is going to be updated. [ 1265.681118] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.681347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.681347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.681555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.681732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.692692] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: IN_PROGRESS for 2s [ 1265.722782] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c46a4f35-1fde-4479-9581-1ff7b201a9b3 with status ACTIVE [ 1265.722978] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.723249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.723249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.724030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.724030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.724030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.724030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.724030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.724030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.724365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.724365] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.724365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.724581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.724710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.724754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.724912] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c46a4f35-1fde-4479-9581-1ff7b201a9b3 is going to be updated. [ 1265.748658] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37b1babe-a5b8-4ddc-adde-c9ed4a126102: rpc.has_security_group_logging(os_id): False [ 1265.752468] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.752468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.752468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.752710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.752740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.752995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c46a4f35-1fde-4479-9581-1ff7b201a9b3" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.768697] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.768981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.768981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.769264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.769421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.770043] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.770210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.770266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.770653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.770797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.770846] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1265.774385] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.774688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.774688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.774978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.775100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.775385] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.775786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.775786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.775911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.775945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.776055] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 is going to be created. [ 1265.820051] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.820051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.820051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.820051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.820051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.836438] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1265.886528] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.886762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.887441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.887441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.887441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.905035] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: IN_PROGRESS for 2s [ 1265.951905] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.951905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.951905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.951905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.951905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.951905] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1266.026572] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.026572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.026572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.026572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.026572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.039883] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1266.521672] env[69756]: INFO networking_nsxv3.common.synchronization [req-caf81999-2052-4f6f-a395-b280bb2022e4 req-2be31fe0-f8b9-4400-be46-dc192afe6feb service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 1266.522524] env[69756]: INFO networking_nsxv3.common.synchronization [req-caf81999-2052-4f6f-a395-b280bb2022e4 req-2be31fe0-f8b9-4400-be46-dc192afe6feb service nova] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1266.522775] env[69756]: INFO networking_nsxv3.common.synchronization [req-caf81999-2052-4f6f-a395-b280bb2022e4 req-2be31fe0-f8b9-4400-be46-dc192afe6feb service nova] Enqueued Resource ID: 33315e30-9c20-478f-8174-66f12465172c with Priority: HIGHEST for action port [ 1266.523734] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_rules [ 1266.523734] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1266.527452] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33315e30-9c20-478f-8174-66f12465172c with Priority: HIGHEST for action port [ 1266.528574] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.528720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.528785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.529182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.529182] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.531587] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.531807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.534548] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-33315e30-9c20-478f-8174-66f12465172c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.534763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33315e30-9c20-478f-8174-66f12465172c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.535097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33315e30-9c20-478f-8174-66f12465172c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.535175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33315e30-9c20-478f-8174-66f12465172c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.538072] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33315e30-9c20-478f-8174-66f12465172c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.538072] env[69756]: INFO networking_nsxv3.common.synchronization [req-3156beb8-6574-4a96-a070-b24fee92111c req-60f9ffb9-0b6d-46d2-a641-221ca7aa3de7 tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1266.538429] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1266.539030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.539193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.539311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.539630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.539756] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.540242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.540242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.540564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.540690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.540917] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.677131] env[69756]: INFO networking_nsxv3.common.synchronization [req-313e40d5-29c9-4c5e-b471-1b27594045a6 req-1dccb91d-ee62-4ab6-8d20-84c7395824b8 tempest-AttachVolumeTestJSON-1233597287 tempest-AttachVolumeTestJSON-1233597287-project-member] Enqueued Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_members [ 1266.677699] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_members [ 1266.678025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.678170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.678235] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.678555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.678776] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.678912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.678997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.680449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.680449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.680449] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.038538] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.038706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.040112] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33315e30-9c20-478f-8174-66f12465172c with status ACTIVE [ 1267.040583] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.040727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.040798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.041104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.041219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.041441] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.041594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.041660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.041883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.041983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.042241] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.042387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.042451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.042608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.042681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.042765] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33315e30-9c20-478f-8174-66f12465172c is going to be updated. [ 1267.044189] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.046024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.046024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.046024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.046024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.046024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.046024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.046024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.046024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.046024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.046024] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1267.078089] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.078449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.078449] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.078585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.078778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.079017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33315e30-9c20-478f-8174-66f12465172c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.087356] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.087578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.087698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.088055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.088278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.101184] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1267.182585] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.182763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.182813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.183041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.183441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.183441] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.183533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.183533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.183878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.183878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.183878] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 already deleted. [ 1267.183982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.247348] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.247598] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-801" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.247707] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-801" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.248124] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-801" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.248558] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.248818] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.249012] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.249331] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.249505] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.249872] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1267.249984] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1267.250098] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1267.250285] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1267.250495] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1267.250653] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1267.250846] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1267.286547] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1267.286774] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1267.286872] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1267.287077] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-801" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.287440] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-1300ce70-851c-4495-9898-bfce14bd5a4c taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.287647] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-1300ce70-851c-4495-9898-bfce14bd5a4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.287821] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-1300ce70-851c-4495-9898-bfce14bd5a4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.288242] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-1300ce70-851c-4495-9898-bfce14bd5a4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.288406] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1300ce70-851c-4495-9898-bfce14bd5a4c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.703331] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 in Status: SUCCESS [ 1267.703757] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 deletion is rescheduled due to dependency. [ 1267.703757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.791469] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.791726] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.791871] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.792287] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.792476] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.792740] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 1300ce70-851c-4495-9898-bfce14bd5a4c not found, creating... [ 1267.793092] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.793296] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.793469] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.793751] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.793919] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.794259] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.794496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.794640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.794907] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.795094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.795266] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 1300ce70-851c-4495-9898-bfce14bd5a4c is going to be created. [ 1267.831050] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.831307] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.831454] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.831929] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.832338] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.832644] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-1300ce70-851c-4495-9898-bfce14bd5a4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.849774] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1267.849774] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 deletion is rescheduled due to dependency. [ 1267.849774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.938339] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: SUCCESS [ 1267.938641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.992993] env[69756]: INFO networking_nsxv3.common.synchronization [None req-f2a6f1e8-6ab5-494d-8c88-b75ebe7fa08e tempest-ServerRescueNegativeTestJSON-1656302266 tempest-ServerRescueNegativeTestJSON-1656302266-project-member] Enqueued Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_rules [ 1267.993828] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_rules [ 1267.995223] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.995385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.995512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.995726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.995818] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.050763] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1268.051150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.051150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.051383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.051579] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.051717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.051798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.051959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.052057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.052155] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.116138] env[69756]: INFO networking_nsxv3.common.synchronization [None req-c5ce925f-01db-464f-9a43-2727bfe70ce9 tempest-ServerRescueNegativeTestJSON-1656302266 tempest-ServerRescueNegativeTestJSON-1656302266-project-member] Enqueued Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_rules [ 1268.116727] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_rules [ 1268.117071] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.117177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.520877] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.521195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.521323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.521645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.521775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.521927] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 already deleted. [ 1268.522082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.522366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.522611] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.522789] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.554220] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.005088] env[69756]: INFO networking_nsxv3.common.synchronization [req-313e40d5-29c9-4c5e-b471-1b27594045a6 req-c95ca151-f0f4-46e1-b8b8-9d1fbea4aab3 service nova] Enqueued Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_rules [ 1269.005088] env[69756]: INFO networking_nsxv3.common.synchronization [req-313e40d5-29c9-4c5e-b471-1b27594045a6 req-c95ca151-f0f4-46e1-b8b8-9d1fbea4aab3 service nova] Enqueued Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_members [ 1269.005088] env[69756]: INFO networking_nsxv3.common.synchronization [req-313e40d5-29c9-4c5e-b471-1b27594045a6 req-c95ca151-f0f4-46e1-b8b8-9d1fbea4aab3 service nova] Enqueued Resource ID: 1300ce70-851c-4495-9898-bfce14bd5a4c with Priority: HIGHEST for action port [ 1269.005088] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_rules [ 1269.005088] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_members [ 1269.005088] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1300ce70-851c-4495-9898-bfce14bd5a4c with Priority: HIGHEST for action port [ 1269.006239] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.006386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.006447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.006749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.006749] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.008116] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.008116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.008299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.008392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.008545] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.008640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.008740] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.008974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.008974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.009613] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.010946] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1300ce70-851c-4495-9898-bfce14bd5a4c taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.010946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1300ce70-851c-4495-9898-bfce14bd5a4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.010946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1300ce70-851c-4495-9898-bfce14bd5a4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.011177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1300ce70-851c-4495-9898-bfce14bd5a4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.011177] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1300ce70-851c-4495-9898-bfce14bd5a4c',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.051131] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.051291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.051365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.051581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.052033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.052033] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 already deleted. [ 1269.052033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.056327] env[69756]: INFO networking_nsxv3.common.synchronization [req-914fe35a-8b27-4de6-8a65-aeef357e1e05 req-001946cd-62c3-4cf0-8c0d-d6685f5ef614 tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1269.056746] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1269.056992] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.057855] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.057999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.058184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.058673] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.058673] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.058801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.059020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.059135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.059262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.059391] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.110513] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 4s [ 1269.512797] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.517603] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.517603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.517603] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1300ce70-851c-4495-9898-bfce14bd5a4c with status ACTIVE [ 1269.517603] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.517603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.517603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.517603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.517603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.517603] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.517603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.517603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.517603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.517603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.517603] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.518664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.518664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.518664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.518664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.518664] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1300ce70-851c-4495-9898-bfce14bd5a4c is going to be updated. [ 1269.541499] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.541704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.542096] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.542516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.542703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.542921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1300ce70-851c-4495-9898-bfce14bd5a4c" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.561077] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.561292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.561335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.561545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.561640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.561803] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1269.565831] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.565831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.565831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.565831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.565831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.566186] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.566186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.566186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.566313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.566313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.566544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1269.599718] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.602186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.602397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.603098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.603342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.606875] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.610523] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.610523] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.610523] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.610523] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.628104] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1269.629070] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1270.015633] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.187661] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.187948] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.188114] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.188441] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.188755] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.188961] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.189142] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.189411] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.189608] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.189978] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.190256] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.190408] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.190538] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.190672] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.190791] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.190939] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.216727] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.217776] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1270.217776] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.217776] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-224" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.217776] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-6982d46d-24a5-4f09-9823-82d0724d13c7 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.217776] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-6982d46d-24a5-4f09-9823-82d0724d13c7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.218091] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-6982d46d-24a5-4f09-9823-82d0724d13c7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.218255] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-6982d46d-24a5-4f09-9823-82d0724d13c7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.218407] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6982d46d-24a5-4f09-9823-82d0724d13c7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.518814] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.518814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.518814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.519096] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.519096] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.519192] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 is going to be created. [ 1270.550390] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.550588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.551154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.551154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.551327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.564128] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 in Status: UNINITIALIZED for 2s [ 1270.721609] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.721884] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.722030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.722356] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.722598] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.722786] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 6982d46d-24a5-4f09-9823-82d0724d13c7 not found, creating... [ 1270.723538] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.723953] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.723953] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.724237] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.724389] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.724736] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.724915] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.725223] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.725299] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.725433] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.725583] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 6982d46d-24a5-4f09-9823-82d0724d13c7 is going to be created. [ 1270.747844] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.748147] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.748249] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.748635] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.748980] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.749344] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-6982d46d-24a5-4f09-9823-82d0724d13c7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.121784] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1271.122170] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 1271.122170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.643448] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1271.645238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.645238] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1271.645238] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 deletion is rescheduled due to dependency. [ 1271.645238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.645238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.645476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.645652] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.645788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.645857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.646488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.646762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.647694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.647694] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.661527] env[69756]: INFO networking_nsxv3.common.synchronization [req-914fe35a-8b27-4de6-8a65-aeef357e1e05 req-fa83d2c3-759a-4856-a22d-fb76c9f30cf3 service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 1271.661768] env[69756]: INFO networking_nsxv3.common.synchronization [req-914fe35a-8b27-4de6-8a65-aeef357e1e05 req-fa83d2c3-759a-4856-a22d-fb76c9f30cf3 service nova] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1271.665893] env[69756]: INFO networking_nsxv3.common.synchronization [req-914fe35a-8b27-4de6-8a65-aeef357e1e05 req-fa83d2c3-759a-4856-a22d-fb76c9f30cf3 service nova] Enqueued Resource ID: 6982d46d-24a5-4f09-9823-82d0724d13c7 with Priority: HIGHEST for action port [ 1271.667377] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_rules [ 1271.667554] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1271.667735] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6982d46d-24a5-4f09-9823-82d0724d13c7 with Priority: HIGHEST for action port [ 1271.668152] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.668341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.668455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.668676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.668826] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.671205] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.671413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.671497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.672054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.672377] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.672565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.672659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.672923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.673067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.673504] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.674650] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-6982d46d-24a5-4f09-9823-82d0724d13c7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.674835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6982d46d-24a5-4f09-9823-82d0724d13c7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.675027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6982d46d-24a5-4f09-9823-82d0724d13c7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.675266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6982d46d-24a5-4f09-9823-82d0724d13c7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.675378] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6982d46d-24a5-4f09-9823-82d0724d13c7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.149715] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.150141] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.150141] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.150428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.150627] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.150775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.150875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.151138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.151274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.151398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.151564] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.151653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.151712] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.151874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.152018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.152117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.152178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.152400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.152487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.152581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.152688] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.180465] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.180465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.180686] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.181932] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6982d46d-24a5-4f09-9823-82d0724d13c7 with status ACTIVE [ 1272.181932] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.181932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.181932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.182155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.182245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.182470] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.182575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.182632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.182788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.182869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.183069] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.183166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.183227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.183360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.183440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.183527] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6982d46d-24a5-4f09-9823-82d0724d13c7 is going to be updated. [ 1272.220716] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.220921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.221108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.221311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.221504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.221717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6982d46d-24a5-4f09-9823-82d0724d13c7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.580204] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 in Status: SUCCESS [ 1272.580500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.580702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.580980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.581225] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.581374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.581440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.581619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.581704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.581807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.582052] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.655145] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8feed-cd04-49d0-9fbe-c89808cf758f: rpc.has_security_group_logging(os_id): False [ 1272.686169] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.693995] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.694220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.694283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.694541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.694733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.694969] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.695098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.695158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.695348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.695472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.695710] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.695817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.695879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.696086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.696167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.696387] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.696517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.696579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.696736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.696829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.696939] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1272.785906] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.786101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.786189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.786373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.786527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.807695] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1273.084881] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.189381] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.189782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.189782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.189849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.189910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.190050] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1273.276895] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.277091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.277236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.277376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.277532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.297465] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1273.588138] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba3e102e-a2e2-4e4c-8876-a8535ec52fd0: rpc.has_security_group_logging(os_id): False [ 1273.606169] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.606375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.606422] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.606617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.606708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.606954] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.607072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.607287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.607488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.607585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.607685] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 is going to be created. [ 1273.675217] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.675420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.675480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.675739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.675976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.688257] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 in Status: IN_PROGRESS for 2s [ 1274.338625] env[69756]: INFO networking_nsxv3.common.synchronization [req-ccb59462-9fe8-4907-9032-483061025f78 req-ff3fe0c5-1c0b-4d17-90db-cf2b6401a7e5 tempest-ServerRescueTestJSON-402335687 tempest-ServerRescueTestJSON-402335687-project-member] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1274.339179] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1274.339493] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.339621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.339691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.339893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.340117] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.340233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.340296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.340550] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.340641] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.340742] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.743848] env[69756]: INFO networking_nsxv3.common.synchronization [req-e1e739df-772a-4eaa-a7f7-60749870e504 req-8aca4283-f631-42f3-ada2-646467b17951 tempest-ServerRescueNegativeTestJSON-1656302266 tempest-ServerRescueNegativeTestJSON-1656302266-project-member] Enqueued Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_members [ 1274.745109] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_members [ 1274.745109] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4298b7-402f-4c7e-8e08-a2f071b6d810 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.745109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.745109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.745109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.745109] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.745555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.745555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.745555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.745555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.745555] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.828846] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1274.829029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.843564] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.071078] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.071288] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.071420] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.071693] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.071953] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.072145] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.072246] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.072533] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.072683] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.072897] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1275.073027] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1275.073147] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1275.073260] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1275.073370] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1275.073598] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1275.073746] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1275.093216] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1275.093402] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1275.093565] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1275.093747] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-893" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.094076] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-54911e52-211a-4bc3-b43b-010db022f16b taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.094243] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-54911e52-211a-4bc3-b43b-010db022f16b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.094367] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-54911e52-211a-4bc3-b43b-010db022f16b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.094738] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-54911e52-211a-4bc3-b43b-010db022f16b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.094897] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54911e52-211a-4bc3-b43b-010db022f16b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.247586] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.247765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.247765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.247963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.248083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.248296] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.248415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.248481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.248653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.248732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.248819] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 already deleted. [ 1275.248901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.309284] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1275.309632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.309831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.310052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.310324] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.310591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.310591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.310915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.310915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.311037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.311089] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.345407] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.597915] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.598222] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.598360] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.598666] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.598829] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.598995] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 54911e52-211a-4bc3-b43b-010db022f16b not found, creating... [ 1275.599288] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.599455] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.599580] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.599813] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.599957] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.600261] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.600426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.600550] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.600764] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.600896] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.601056] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 54911e52-211a-4bc3-b43b-010db022f16b is going to be created. [ 1275.621877] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.622141] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.623924] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.623924] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.623924] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.623924] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-54911e52-211a-4bc3-b43b-010db022f16b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.706772] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 in Status: SUCCESS [ 1275.706929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.819906] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.819906] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.819906] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.819906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.820383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.820383] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.820383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.820494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.820582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.820672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.821973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.821973] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.849697] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.849697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.849697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.850094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.850224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.850400] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e14423-20f6-4632-a776-83c92acbd98e is going to be updated. [ 1275.886600] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.886821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.886874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.887120] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.887326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.898443] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: IN_PROGRESS for 2s [ 1276.326101] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8: rpc.has_security_group_logging(os_id): False [ 1276.353325] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.353325] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.353325] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.353325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.354058] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.354058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.354058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.354058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.354058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.354058] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1276.428682] env[69756]: INFO networking_nsxv3.common.synchronization [req-e1e739df-772a-4eaa-a7f7-60749870e504 req-4b34efc8-36c4-47ed-8237-ac51e3297377 service nova] Enqueued Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_rules [ 1276.428895] env[69756]: INFO networking_nsxv3.common.synchronization [req-e1e739df-772a-4eaa-a7f7-60749870e504 req-4b34efc8-36c4-47ed-8237-ac51e3297377 service nova] Enqueued Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_members [ 1276.429077] env[69756]: INFO networking_nsxv3.common.synchronization [req-e1e739df-772a-4eaa-a7f7-60749870e504 req-4b34efc8-36c4-47ed-8237-ac51e3297377 service nova] Enqueued Resource ID: 54911e52-211a-4bc3-b43b-010db022f16b with Priority: HIGHEST for action port [ 1276.429670] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_rules [ 1276.429814] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_members [ 1276.429913] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54911e52-211a-4bc3-b43b-010db022f16b with Priority: HIGHEST for action port [ 1276.430303] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.430493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.430594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.430747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.430896] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.431725] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4298b7-402f-4c7e-8e08-a2f071b6d810 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.431833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.431901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.432109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.432426] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.432426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.432426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.432609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.432645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.432733] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.433555] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-54911e52-211a-4bc3-b43b-010db022f16b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.433662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54911e52-211a-4bc3-b43b-010db022f16b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.433730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54911e52-211a-4bc3-b43b-010db022f16b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.433880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54911e52-211a-4bc3-b43b-010db022f16b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.433956] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54911e52-211a-4bc3-b43b-010db022f16b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.437382] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.437515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.437586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.441598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.441598] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.464584] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1276.936520] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54911e52-211a-4bc3-b43b-010db022f16b with status ACTIVE [ 1276.936761] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.936900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.936973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.937256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.937353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.937546] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.937658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.937728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.937885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.937962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.938176] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.938263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.938339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.938472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.938539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.938637] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54911e52-211a-4bc3-b43b-010db022f16b is going to be updated. [ 1276.939831] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4298b7-402f-4c7e-8e08-a2f071b6d810 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.939961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.940131] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.964476] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.964743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.964743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.964956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.965156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.965408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54911e52-211a-4bc3-b43b-010db022f16b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.288377] env[69756]: INFO networking_nsxv3.common.synchronization [req-4b4a4705-e86b-4095-98d7-1e8811996ffa req-d490e74a-dd4d-4bb9-a78f-09a55df3fc22 tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1277.289023] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1277.289408] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.289530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.289605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.289875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.290914] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.291054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.291133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.291357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.291510] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.291706] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.442678] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.619985] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.620131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.620179] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.620611] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.620946] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.621160] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.621295] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.621607] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.621785] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.622766] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1277.622766] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1277.622766] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1277.622766] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1277.622766] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1277.622766] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1277.623190] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1277.645876] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1277.645876] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1277.645876] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1277.645876] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-836" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.645876] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.645876] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.646210] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.646420] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.646596] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.794996] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.795167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.795254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.795472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.795559] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.795755] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.795850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.795911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.796085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.796199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.796267] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1277.945469] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.945662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.945705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.945902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.945989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.946101] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 is going to be created. [ 1277.961408] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: SUCCESS [ 1277.961707] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.982263] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.982263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.982263] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.982591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.982690] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.985992] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.986718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.986806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.986989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.987267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.997971] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 in Status: UNINITIALIZED for 2s [ 1277.999091] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1278.154094] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.154094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.154094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.154094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.154094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.154094] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68 not found, creating... [ 1278.154094] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.154094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.154094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.154094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.154094] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.154806] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.155271] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.155633] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.156127] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.156474] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.156842] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68 is going to be created. [ 1278.201323] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.201559] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.201916] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.202021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.202211] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.202660] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.491155] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1278.491474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.985067] env[69756]: INFO networking_nsxv3.common.synchronization [req-4b4a4705-e86b-4095-98d7-1e8811996ffa req-2ee47c40-6182-448d-8f0d-2ade5a1a98c7 service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 1278.985067] env[69756]: INFO networking_nsxv3.common.synchronization [req-4b4a4705-e86b-4095-98d7-1e8811996ffa req-2ee47c40-6182-448d-8f0d-2ade5a1a98c7 service nova] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1278.985067] env[69756]: INFO networking_nsxv3.common.synchronization [req-4b4a4705-e86b-4095-98d7-1e8811996ffa req-2ee47c40-6182-448d-8f0d-2ade5a1a98c7 service nova] Enqueued Resource ID: 1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68 with Priority: HIGHEST for action port [ 1278.985067] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_rules [ 1278.985067] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1278.985067] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68 with Priority: HIGHEST for action port [ 1278.985067] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.985067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.985682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.986053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.986872] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.987669] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.987669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.989106] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.989106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.989106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.989106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.989106] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.490587] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68 with status ACTIVE [ 1279.491436] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.491436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.491436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.491436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.491436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.491849] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.491849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.491849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.491849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.491992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.493051] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.493051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.493051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.493051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.493051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.493051] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68 is going to be updated. [ 1279.494745] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.494859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.521792] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.521931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.521997] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.522228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.522368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.522546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f6a8c68-0feb-4b03-9da3-d9d29cdb4a68" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.642324] env[69756]: INFO networking_nsxv3.common.synchronization [req-271562d8-d250-4350-9b9c-c16d90a52560 req-5e8a27f6-aa6d-4915-8454-ad1bef11b41a tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1279.642943] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1279.643290] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.643439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.643511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.643739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.643900] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.644112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.644205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.644402] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.644492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.644613] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.011484] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 in Status: SUCCESS [ 1280.011734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.012561] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1280.012737] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 1280.012819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.012984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.013259] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.013484] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.013649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.013721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.013900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.017590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.017590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.017590] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.018672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.022764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.022764] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.022764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.022764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.022764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.022764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.022764] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.148737] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.169298] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.169298] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.169298] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.173455] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.173924] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.174088] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.174257] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.174556] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.174768] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.175022] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.175182] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1280.175332] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1280.175483] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1280.175633] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.175780] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1280.175957] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1280.206429] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1280.206603] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1280.206799] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1280.206998] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.207351] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-1aae6259-77ea-4073-96b8-3d96ccf47ad9 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.207525] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-1aae6259-77ea-4073-96b8-3d96ccf47ad9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.207655] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-1aae6259-77ea-4073-96b8-3d96ccf47ad9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.208017] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-1aae6259-77ea-4073-96b8-3d96ccf47ad9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.208170] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aae6259-77ea-4073-96b8-3d96ccf47ad9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.521978] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.523850] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.651170] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.712193] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.712384] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.712568] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.712877] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.713070] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.713250] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 1aae6259-77ea-4073-96b8-3d96ccf47ad9 not found, creating... [ 1280.713547] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.713716] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.713853] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.714112] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.714263] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.714588] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.714791] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.714928] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.715194] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.715345] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.715949] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 1aae6259-77ea-4073-96b8-3d96ccf47ad9 is going to be created. [ 1280.738412] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.738673] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.738817] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.739137] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.739390] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.739641] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-1aae6259-77ea-4073-96b8-3d96ccf47ad9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.024360] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b4298b7-402f-4c7e-8e08-a2f071b6d810: rpc.has_security_group_logging(os_id): False [ 1281.026299] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.047733] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.048163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.048326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.048733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.048933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.049496] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.049719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.049862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.050242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.050470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.050644] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 is going to be created. [ 1281.126111] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.126319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.126423] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.126679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.127171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.143310] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 in Status: IN_PROGRESS for 2s [ 1281.153959] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.154160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.154242] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.154430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.154518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.154708] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 is going to be updated. [ 1281.197157] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.197390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.197494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.197820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.197968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.213253] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: IN_PROGRESS for 2s [ 1281.532343] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.532343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.532343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.532343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.532343] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.532343] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1281.567026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.567026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.567026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.567026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.567026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.577302] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1281.956768] env[69756]: INFO networking_nsxv3.common.synchronization [req-271562d8-d250-4350-9b9c-c16d90a52560 req-c643a696-b66f-40ab-9d91-97002747af07 service nova] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_rules [ 1281.957050] env[69756]: INFO networking_nsxv3.common.synchronization [req-271562d8-d250-4350-9b9c-c16d90a52560 req-c643a696-b66f-40ab-9d91-97002747af07 service nova] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1281.957224] env[69756]: INFO networking_nsxv3.common.synchronization [req-271562d8-d250-4350-9b9c-c16d90a52560 req-c643a696-b66f-40ab-9d91-97002747af07 service nova] Enqueued Resource ID: 1aae6259-77ea-4073-96b8-3d96ccf47ad9 with Priority: HIGHEST for action port [ 1281.958182] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_rules [ 1281.958182] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1281.958619] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aae6259-77ea-4073-96b8-3d96ccf47ad9 with Priority: HIGHEST for action port [ 1281.959065] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.959334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.959334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.959595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.959717] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.960846] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.961026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.961279] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aae6259-77ea-4073-96b8-3d96ccf47ad9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.961386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aae6259-77ea-4073-96b8-3d96ccf47ad9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.961453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aae6259-77ea-4073-96b8-3d96ccf47ad9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.961606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aae6259-77ea-4073-96b8-3d96ccf47ad9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.961702] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aae6259-77ea-4073-96b8-3d96ccf47ad9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.124642] env[69756]: INFO networking_nsxv3.common.synchronization [req-e1e2bfb9-77bd-48e7-b170-7cb067f226da req-bb8e8dec-b24a-43ad-b1fe-edd4b49732e8 tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1282.125317] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1282.125652] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.125794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.125858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.126102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.126326] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.126380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.126485] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.126624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.126691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.126790] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.463588] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.463829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.467118] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1aae6259-77ea-4073-96b8-3d96ccf47ad9 with status ACTIVE [ 1282.467314] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.467434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.467493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.467862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.467862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.467957] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.468064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.468125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.468287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.468391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.468541] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.468637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.468884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.468884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.468884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.469014] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1aae6259-77ea-4073-96b8-3d96ccf47ad9 is going to be updated. [ 1282.491663] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.491845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.491905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.492118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.492259] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.492462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aae6259-77ea-4073-96b8-3d96ccf47ad9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.634038] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.137294] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.166164] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 in Status: SUCCESS [ 1283.166164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.246988] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: SUCCESS [ 1283.247477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.247579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.247810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.248016] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.248145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.248207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.248368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.248450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.248547] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.588103] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1283.588328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.588505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.588739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.588944] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.589141] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.589186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.589312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.589393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.589483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.589575] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.641482] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.641880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.642014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.642431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.642537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.642642] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1283.680568] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.680568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.680807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.681895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.681895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.690935] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1283.750989] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.986833] env[69756]: INFO networking_nsxv3.common.synchronization [req-60070fbe-c1d0-4545-aa5c-1abbb9d801f3 req-3c414f9b-93f3-4d61-a22a-c92a919b21d2 tempest-VolumesAdminNegativeTest-1357987219 tempest-VolumesAdminNegativeTest-1357987219-project-member] Enqueued Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGHEST for action security_group_members [ 1283.986833] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGHEST for action security_group_members [ 1283.987720] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af15216-8a46-487f-bf50-9d818405d3fe taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.988140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.988342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.988818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.989156] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.991019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.991019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.991019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.991019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.991019] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1af15216-8a46-487f-bf50-9d818405d3fe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.092494] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.092688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.092764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.092989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.093172] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.093867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.093867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.093867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.093867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.093867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.093867] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.094173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.094173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.094173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.094313] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.094363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.094543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.094679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.094949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.095023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.095290] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.232025] env[69756]: INFO networking_nsxv3.common.synchronization [req-a205db84-c066-4bdb-bdfe-cb768607561f req-7b6292b0-bd86-46e0-b511-eeae0c0e4453 tempest-ServerRescueTestJSON-402335687 tempest-ServerRescueTestJSON-402335687-project-member] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1284.232025] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGHEST for action security_group_members [ 1284.232025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.232025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.232025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.232025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.232638] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.232887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.233059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.233356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.233580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.233774] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.254138] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.458042] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.458042] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-449" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.458297] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-449" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.458380] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-449" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.458668] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.459373] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.459373] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.459373] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.459631] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.459669] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1284.461909] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1284.461909] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1284.461909] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1284.461909] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1284.461909] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1284.461909] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1284.484494] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1284.484678] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1284.484853] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1284.485054] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-449" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.485396] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.485582] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.485709] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.486091] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.486245] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea82a40e-4c2f-45e3-b913-3a9da9bc961d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.495614] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.495755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.495824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.496051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.496143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.496334] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.496432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.496495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.496654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.496727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.496811] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af15216-8a46-487f-bf50-9d818405d3fe already deleted. [ 1284.496889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.597413] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d711ed5-98da-4810-9f03-9148ad645008: rpc.has_security_group_logging(os_id): False [ 1284.618219] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.618435] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.618435] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.618680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.618792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.619183] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.619183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.619281] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.619424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.619512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.619698] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.619790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.619864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.620102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.620309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.620557] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.620777] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.620777] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.620895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.620980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.621084] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1284.710995] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.711340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.711340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.711754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.712331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.737049] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.737339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.737339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.737582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.737658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.737881] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.737985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.738049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.738220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.738291] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.738402] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e14423-20f6-4632-a776-83c92acbd98e is going to be updated. [ 1284.740520] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1284.757019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.757220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.757266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.757469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.757558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.757659] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 is going to be updated. [ 1284.793431] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.793692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.793885] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.794118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.794271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.812959] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: IN_PROGRESS for 2s [ 1284.818692] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.818899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.818899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.819160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.819313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.828421] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: IN_PROGRESS for 2s [ 1284.989016] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.989421] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.989569] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.990408] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.990577] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.990753] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port ea82a40e-4c2f-45e3-b913-3a9da9bc961d not found, creating... [ 1284.991081] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.991254] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.991381] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.991635] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.991785] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.992090] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.992258] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.992393] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.992690] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.992857] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.992982] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: ea82a40e-4c2f-45e3-b913-3a9da9bc961d is going to be created. [ 1285.037144] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.037632] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.037817] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.038122] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.038369] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.038954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.429949] env[69756]: INFO networking_nsxv3.common.synchronization [req-65bb1b52-5bfe-4b63-b1ef-ca2178026bc2 req-858a519a-0fe7-4eb9-b10c-c8fd4750e171 tempest-ServerDiskConfigTestJSON-398101479 tempest-ServerDiskConfigTestJSON-398101479-project-member] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1285.431176] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGHEST for action security_group_members [ 1285.431863] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.432208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.432377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.432811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.433091] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.433327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.433508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.435023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.435023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.435023] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.705334] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1285.708328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.826914] env[69756]: INFO networking_nsxv3.common.synchronization [req-60070fbe-c1d0-4545-aa5c-1abbb9d801f3 req-4ee232a4-7686-4334-836d-121b1a2747d2 service nova] Enqueued Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGHEST for action security_group_rules [ 1285.827200] env[69756]: INFO networking_nsxv3.common.synchronization [req-60070fbe-c1d0-4545-aa5c-1abbb9d801f3 req-4ee232a4-7686-4334-836d-121b1a2747d2 service nova] Enqueued Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGHEST for action security_group_members [ 1285.827328] env[69756]: INFO networking_nsxv3.common.synchronization [req-60070fbe-c1d0-4545-aa5c-1abbb9d801f3 req-4ee232a4-7686-4334-836d-121b1a2747d2 service nova] Enqueued Resource ID: ea82a40e-4c2f-45e3-b913-3a9da9bc961d with Priority: HIGHEST for action port [ 1285.827625] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGHEST for action security_group_rules [ 1285.827760] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGHEST for action security_group_members [ 1285.827855] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea82a40e-4c2f-45e3-b913-3a9da9bc961d with Priority: HIGHEST for action port [ 1285.830587] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1af15216-8a46-487f-bf50-9d818405d3fe taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.830587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.830587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.830833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.830917] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1af15216-8a46-487f-bf50-9d818405d3fe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.832240] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af15216-8a46-487f-bf50-9d818405d3fe taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.832353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.832353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.833029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.833029] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.833029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.833029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.833029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.833257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.833257] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1af15216-8a46-487f-bf50-9d818405d3fe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.833761] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.833971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.833971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.834193] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.834193] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea82a40e-4c2f-45e3-b913-3a9da9bc961d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.937481] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.937719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.937719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.938074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.938223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.938427] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.938539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.938615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.938775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.938881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.939098] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be updated. [ 1285.974136] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.974136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.974136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.974383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.974383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.984906] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: IN_PROGRESS for 2s [ 1286.335703] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af15216-8a46-487f-bf50-9d818405d3fe taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.335865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.336114] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea82a40e-4c2f-45e3-b913-3a9da9bc961d with status ACTIVE [ 1286.336291] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.336399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.336469] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.336684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.336781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.336960] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.337065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.337121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.337281] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.337358] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.337538] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.337632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.337693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.337837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.337901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.337985] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea82a40e-4c2f-45e3-b913-3a9da9bc961d is going to be updated. [ 1286.339693] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1af15216-8a46-487f-bf50-9d818405d3fe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.364471] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.364817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.364965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.365293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.365519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.365751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea82a40e-4c2f-45e3-b913-3a9da9bc961d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.757119] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1286.757499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.828268] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e14423-20f6-4632-a776-83c92acbd98e in Status: SUCCESS [ 1286.828268] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e14423-20f6-4632-a776-83c92acbd98e deletion is rescheduled due to dependency. [ 1286.828742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.841035] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: SUCCESS [ 1286.841244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.842036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.842305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.842654] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.842957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.842957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.843295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.843478] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.843572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.843689] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.844858] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1af15216-8a46-487f-bf50-9d818405d3fe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.347501] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.351390] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.351390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.351390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.351390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.351390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.351979] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af15216-8a46-487f-bf50-9d818405d3fe is going to be created. [ 1287.379130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.379376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.379376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.379586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.379810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.398976] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af15216-8a46-487f-bf50-9d818405d3fe in Status: UNINITIALIZED for 2s [ 1287.848846] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37b1babe-a5b8-4ddc-adde-c9ed4a126102: rpc.has_security_group_logging(os_id): False [ 1287.868588] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.868785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.868860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.869148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.869249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.869542] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.869660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.869794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.869896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.869975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.870097] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 is going to be updated. [ 1287.951428] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.951736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.951834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.952153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.952334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.974866] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: IN_PROGRESS for 2s [ 1287.996289] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 in Status: SUCCESS [ 1287.996579] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 deletion is rescheduled due to dependency. [ 1287.996767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.699129] env[69756]: INFO networking_nsxv3.common.synchronization [req-3e8a6bfc-093e-4896-aaac-ffa702d41da3 req-085bb7df-07bb-41dc-a6c6-7741e8a0f06f tempest-ServersTestJSON-676020567 tempest-ServersTestJSON-676020567-project-member] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1288.699695] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGHEST for action security_group_members [ 1288.700042] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.700168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.700234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.700460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.700613] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.700706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.700769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.700995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.702348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.703792] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.208531] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.208843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.208843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.209074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.209185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.209401] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.209514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.209581] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.209776] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.209964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.209964] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be updated. [ 1289.265422] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.265632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.265632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.265874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.266034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.283846] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: IN_PROGRESS for 2s [ 1289.409212] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af15216-8a46-487f-bf50-9d818405d3fe in Status: SUCCESS [ 1289.409492] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.409708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.410010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.410263] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.410412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.410509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.410722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.410829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.410942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.411075] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1af15216-8a46-487f-bf50-9d818405d3fe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.913745] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af15216-8a46-487f-bf50-9d818405d3fe taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.914084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.914084] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.915124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.915124] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.915124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.915124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.915124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.915374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.915374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.915374] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af15216-8a46-487f-bf50-9d818405d3fe taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.915491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.916511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.916511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.916511] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.916511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.916511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.916511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.916511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.916511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.916511] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1af15216-8a46-487f-bf50-9d818405d3fe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.993347] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: SUCCESS [ 1289.994279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.346351] env[69756]: INFO networking_nsxv3.common.synchronization [None req-b5beb10d-b09c-416c-85ec-2b5419d8e563 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1290.346895] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1290.347229] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.347355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.347430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.347642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.347854] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.347909] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.347949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.348278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.348369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.348470] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.418972] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1af15216-8a46-487f-bf50-9d818405d3fe: rpc.has_security_group_logging(os_id): False [ 1290.441179] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.441179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.441179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.441179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.441179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.441179] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.441179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.441179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.441179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.441179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.441714] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.441960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.442144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.444835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.444835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.444835] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.444835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.444835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.444835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.444835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.444835] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1af15216-8a46-487f-bf50-9d818405d3fe is going to be created. [ 1290.513082] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.513262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.513317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.513534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.513764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.526683] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1af15216-8a46-487f-bf50-9d818405d3fe in Status: IN_PROGRESS for 2s [ 1290.851461] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.851461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.851461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.851718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.876104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.876104] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.876104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.876104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.876104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.876328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.876328] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1290.911765] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.911765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.911971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.912215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.912305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.923430] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1291.297016] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f in Status: SUCCESS [ 1291.297016] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f deletion is rescheduled due to dependency. [ 1291.297016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.541158] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1af15216-8a46-487f-bf50-9d818405d3fe in Status: SUCCESS [ 1292.541497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.946918] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1292.946918] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 deletion is rescheduled due to dependency. [ 1292.946918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.065804] env[69756]: INFO networking_nsxv3.common.synchronization [req-51c57710-2ed1-49ab-a8dd-dc7b7865a8b7 req-140998f9-6f01-4941-b94a-47adf03eefb3 tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 1294.067734] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 1294.068461] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.068461] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.068615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.068893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.069133] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.069588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.069588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.069742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.069742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.069890] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.254531] env[69756]: INFO networking_nsxv3.common.synchronization [None req-78eea72c-00f9-4c82-830b-66ede8d94ffa None None] Enqueued Resource ID: b55a9ec1-c928-4663-8446-710fa8dbab5f with Priority: HIGHEST for action port [ 1294.254873] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55a9ec1-c928-4663-8446-710fa8dbab5f with Priority: HIGHEST for action port [ 1294.255462] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b55a9ec1-c928-4663-8446-710fa8dbab5f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.255462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b55a9ec1-c928-4663-8446-710fa8dbab5f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.255462] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b55a9ec1-c928-4663-8446-710fa8dbab5f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.255720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b55a9ec1-c928-4663-8446-710fa8dbab5f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.255806] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b55a9ec1-c928-4663-8446-710fa8dbab5f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.579118] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.762902] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b55a9ec1-c928-4663-8446-710fa8dbab5f [ 1294.762902] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.762902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.762902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.762902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.762902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.762902] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b55a9ec1-c928-4663-8446-710fa8dbab5f already deleted. [ 1294.762902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b55a9ec1-c928-4663-8446-710fa8dbab5f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.806728] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.806728] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.806728] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.806984] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.807185] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.807294] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.807397] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.807627] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.807786] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.808017] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.808447] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.808612] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.808778] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.808936] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.809312] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.809515] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.829859] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.830075] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1294.830412] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.830412] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.830758] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.830943] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.831126] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.831479] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.831630] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.083293] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.335788] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.335788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.335788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.335788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.335788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.335788] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5 not found, creating... [ 1295.336375] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.336375] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.336375] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.336644] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.337073] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.337633] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.337882] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.337951] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.339108] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.339108] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.339108] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5 is going to be created. [ 1295.355104] env[69756]: INFO networking_nsxv3.common.synchronization [None req-488f3f7f-1bd9-4178-a9af-6eb101daff8d tempest-AttachVolumeShelveTestJSON-990643214 tempest-AttachVolumeShelveTestJSON-990643214-project-member] Enqueued Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_rules [ 1295.355653] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_rules [ 1295.355966] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.359065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.359065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.359065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.359065] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.362030] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.362030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.362030] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.362682] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.363015] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.363318] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.465604] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8acc2244-530e-4d1a-a47c-7942535f70e8 tempest-AttachVolumeShelveTestJSON-990643214 tempest-AttachVolumeShelveTestJSON-990643214-project-member] Enqueued Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_rules [ 1295.465604] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_rules [ 1295.465604] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.465816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.585701] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.585925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.585925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.586168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.586252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.586358] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b is going to be updated. [ 1295.647015] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.647015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.648337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.648337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.648337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.658426] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: IN_PROGRESS for 2s [ 1295.886392] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.886620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.886620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.886862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.886935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.886987] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c14839ba-8bdf-4b61-a062-7509aa291e61 already deleted. [ 1295.887094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.887225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.887399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.887561] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.409239] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.409577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.409577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.409684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.409784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.409893] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c14839ba-8bdf-4b61-a062-7509aa291e61 already deleted. [ 1296.410028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.486540] env[69756]: INFO networking_nsxv3.common.synchronization [req-51c57710-2ed1-49ab-a8dd-dc7b7865a8b7 req-f0e0e632-fcd3-4aa1-acc6-cc9de8ce0d44 service nova] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_rules [ 1296.486730] env[69756]: INFO networking_nsxv3.common.synchronization [req-51c57710-2ed1-49ab-a8dd-dc7b7865a8b7 req-f0e0e632-fcd3-4aa1-acc6-cc9de8ce0d44 service nova] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 1296.486874] env[69756]: INFO networking_nsxv3.common.synchronization [req-51c57710-2ed1-49ab-a8dd-dc7b7865a8b7 req-f0e0e632-fcd3-4aa1-acc6-cc9de8ce0d44 service nova] Enqueued Resource ID: b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5 with Priority: HIGHEST for action port [ 1296.487129] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_rules [ 1296.487261] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 1296.487359] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5 with Priority: HIGHEST for action port [ 1296.487901] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.488409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.488529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.488743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.489099] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.490092] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.490464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.490464] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.490762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.490762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.490945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.490945] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.521247] env[69756]: INFO networking_nsxv3.common.synchronization [None req-701485b3-0e7e-484c-998e-3b91150fa890 None None] Enqueued Resource ID: c7f6be50-ea18-43e5-9cd5-e662dddbdb4b with Priority: HIGHEST for action port [ 1296.521924] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f6be50-ea18-43e5-9cd5-e662dddbdb4b with Priority: HIGHEST for action port [ 1296.523080] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7f6be50-ea18-43e5-9cd5-e662dddbdb4b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.523434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7f6be50-ea18-43e5-9cd5-e662dddbdb4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.523557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7f6be50-ea18-43e5-9cd5-e662dddbdb4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.523849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7f6be50-ea18-43e5-9cd5-e662dddbdb4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.523932] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7f6be50-ea18-43e5-9cd5-e662dddbdb4b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.783833] env[69756]: INFO networking_nsxv3.common.synchronization [None req-16bd6104-c485-4159-b793-7e66c5420590 None None] Enqueued Resource ID: c305748f-fefe-478b-b6e8-29890ddacb5d with Priority: HIGHEST for action port [ 1296.783975] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c305748f-fefe-478b-b6e8-29890ddacb5d with Priority: HIGHEST for action port [ 1296.784550] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-c305748f-fefe-478b-b6e8-29890ddacb5d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.784702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c305748f-fefe-478b-b6e8-29890ddacb5d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.784780] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c305748f-fefe-478b-b6e8-29890ddacb5d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.785264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c305748f-fefe-478b-b6e8-29890ddacb5d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.785363] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c305748f-fefe-478b-b6e8-29890ddacb5d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.992212] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.992385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.993930] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5 with status ACTIVE [ 1296.994084] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.994257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.994323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.994587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.994684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.994923] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.995061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.995166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.995317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.995416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.995615] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.995722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.995790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.995953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.996160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.996160] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5 is going to be updated. [ 1297.021486] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.021644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.021695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.021891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.022488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.022488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f76a17-b276-4c7c-a6a4-4f91bf4ddfb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.026700] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7f6be50-ea18-43e5-9cd5-e662dddbdb4b [ 1297.027024] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.027960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.028272] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.028429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.028535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.029034] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7f6be50-ea18-43e5-9cd5-e662dddbdb4b already deleted. [ 1297.029034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7f6be50-ea18-43e5-9cd5-e662dddbdb4b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.288018] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c305748f-fefe-478b-b6e8-29890ddacb5d [ 1297.288018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.288255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.288255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.288414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.288511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.288613] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c305748f-fefe-478b-b6e8-29890ddacb5d already deleted. [ 1297.288697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c305748f-fefe-478b-b6e8-29890ddacb5d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.670636] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: SUCCESS [ 1297.670636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.674025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.674025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.674025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.674025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.674025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.674025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.674025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.674025] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.176440] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.594895] env[69756]: INFO networking_nsxv3.common.synchronization [None req-61079a8e-8215-49de-b82e-9b9ae6f27c9e None None] Enqueued Resource ID: f3dad6dc-c950-44e5-9ad6-e2cce18b44db with Priority: HIGHEST for action port [ 1298.594895] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3dad6dc-c950-44e5-9ad6-e2cce18b44db with Priority: HIGHEST for action port [ 1298.594895] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3dad6dc-c950-44e5-9ad6-e2cce18b44db taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.594895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3dad6dc-c950-44e5-9ad6-e2cce18b44db" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.594895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3dad6dc-c950-44e5-9ad6-e2cce18b44db" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.594895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3dad6dc-c950-44e5-9ad6-e2cce18b44db" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.594895] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3dad6dc-c950-44e5-9ad6-e2cce18b44db',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.678838] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.104181] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3dad6dc-c950-44e5-9ad6-e2cce18b44db [ 1299.104987] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.104987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.105697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.105697] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3dad6dc-c950-44e5-9ad6-e2cce18b44db already deleted. [ 1299.105912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3dad6dc-c950-44e5-9ad6-e2cce18b44db" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.181898] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.183959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.184109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.184330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.185022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.185022] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b is going to be updated. [ 1299.265972] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.265972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.265972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.266770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.266770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.290102] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: IN_PROGRESS for 2s [ 1300.381671] env[69756]: INFO networking_nsxv3.common.synchronization [req-9a125051-288c-4cb4-9cd5-440004c70f42 req-3ef3d9c4-3ebd-4b2c-82a5-f42397e24526 tempest-VolumesAdminNegativeTest-1357987219 tempest-VolumesAdminNegativeTest-1357987219-project-member] Enqueued Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGHEST for action security_group_members [ 1300.382260] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGHEST for action security_group_members [ 1300.382620] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af15216-8a46-487f-bf50-9d818405d3fe taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.382742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.383066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.383066] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.383206] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.383290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.383362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.383503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.383600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.383693] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1af15216-8a46-487f-bf50-9d818405d3fe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.888019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.888261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.888342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.888580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.888678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.888903] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.889013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.889079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.889243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.889324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.889440] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af15216-8a46-487f-bf50-9d818405d3fe is going to be updated. [ 1300.931507] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.931769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.931769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.931927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.932100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.943478] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af15216-8a46-487f-bf50-9d818405d3fe in Status: IN_PROGRESS for 2s [ 1301.301251] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: SUCCESS [ 1301.301540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.301729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.301968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.302200] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.302321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.302383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.302591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.302705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.302747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.302845] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.806454] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.262277] env[69756]: INFO networking_nsxv3.common.synchronization [req-55d412eb-1c0a-44e6-953c-3604e59fedc5 req-b855d596-b4dd-4d77-9a0e-a9c71876c8f3 tempest-AttachVolumeShelveTestJSON-990643214 tempest-AttachVolumeShelveTestJSON-990643214-project-member] Enqueued Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_members [ 1302.262886] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_members [ 1302.263272] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.263388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.263467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.263767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.263939] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.264064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.264130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.264331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.264423] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.264528] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.308597] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91d49c48-1e8f-4b77-9b74-b8d508a2115b: rpc.has_security_group_logging(os_id): False [ 1302.330654] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.330818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.330818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.331022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.356143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.356466] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.356580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.356651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.356866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.356953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.357059] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b is going to be updated. [ 1302.423887] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.424212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.424212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.424368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.424567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.438969] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: IN_PROGRESS for 2s [ 1302.681025] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.681280] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.681422] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.681752] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.682034] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.682201] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.682325] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.682616] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.682815] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.683090] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.683273] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1302.683468] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1302.683629] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1302.683761] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.683879] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1302.684029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1302.704806] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1302.705316] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1302.705417] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1302.705555] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.705892] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-5f04eb8e-010b-4598-8810-4e9786a6ac73 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.706096] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.706231] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.706597] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.706749] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f04eb8e-010b-4598-8810-4e9786a6ac73',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.766469] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.766663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.766717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.766915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.767015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.767216] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.767416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.767416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.767515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.767590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.767676] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c14839ba-8bdf-4b61-a062-7509aa291e61 already deleted. [ 1302.767758] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.955483] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af15216-8a46-487f-bf50-9d818405d3fe in Status: SUCCESS [ 1302.955953] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af15216-8a46-487f-bf50-9d818405d3fe deletion is rescheduled due to dependency. [ 1302.955953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.209781] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.210058] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.210238] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.210634] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.210832] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.211086] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 5f04eb8e-010b-4598-8810-4e9786a6ac73 not found, creating... [ 1303.211391] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.211565] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.211690] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.211943] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.212103] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.212412] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.212623] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.212757] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.213063] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.213274] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.213490] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 5f04eb8e-010b-4598-8810-4e9786a6ac73 is going to be created. [ 1303.256611] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.257034] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.257216] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.257586] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.257900] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.258201] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.968800] env[69756]: INFO networking_nsxv3.common.synchronization [req-55d412eb-1c0a-44e6-953c-3604e59fedc5 req-d3fb65f4-c31b-45b0-985f-332cd1531013 service nova] Enqueued Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_rules [ 1303.969046] env[69756]: INFO networking_nsxv3.common.synchronization [req-55d412eb-1c0a-44e6-953c-3604e59fedc5 req-d3fb65f4-c31b-45b0-985f-332cd1531013 service nova] Enqueued Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_members [ 1303.969046] env[69756]: INFO networking_nsxv3.common.synchronization [req-55d412eb-1c0a-44e6-953c-3604e59fedc5 req-d3fb65f4-c31b-45b0-985f-332cd1531013 service nova] Enqueued Resource ID: 5f04eb8e-010b-4598-8810-4e9786a6ac73 with Priority: HIGHEST for action port [ 1303.969843] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_rules [ 1303.969843] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_members [ 1303.969843] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f04eb8e-010b-4598-8810-4e9786a6ac73 with Priority: HIGHEST for action port [ 1303.970223] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.970374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.970426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.970630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.970726] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.971978] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.972106] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.972165] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.972468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.972651] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.972761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.972832] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.972957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.973052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.973143] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.974669] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f04eb8e-010b-4598-8810-4e9786a6ac73 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.974790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.974883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.975045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.975146] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f04eb8e-010b-4598-8810-4e9786a6ac73',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.203320] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.203559] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.203730] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.204037] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.204307] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.204483] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.204607] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.204834] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.204986] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.205219] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.205341] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1304.205459] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1304.205575] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1304.205693] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.205807] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1304.205944] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1304.228124] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1304.228324] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1304.228474] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1304.228658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.229112] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-90178801-6693-4147-a140-74bc27ea5e82 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.229283] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.229433] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.229778] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.229920] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90178801-6693-4147-a140-74bc27ea5e82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.364801] env[69756]: INFO networking_nsxv3.common.synchronization [req-1e652a5e-e72e-41e6-905f-1e5ba1f4d3a0 req-b9206f46-5c4a-4fba-a418-5083cf384183 tempest-InstanceActionsNegativeTestJSON-2097532457 tempest-InstanceActionsNegativeTestJSON-2097532457-project-member] Enqueued Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGHEST for action security_group_members [ 1304.365425] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGHEST for action security_group_members [ 1304.366088] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f81967-0f86-4790-a162-021bab0aad8d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.366088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.366088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.366773] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.366960] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.367082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.367150] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.367314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.367403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.367499] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35f81967-0f86-4790-a162-021bab0aad8d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.451997] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: SUCCESS [ 1304.452249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.472394] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.472649] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.477046] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f04eb8e-010b-4598-8810-4e9786a6ac73 with status ACTIVE [ 1304.477263] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.477393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.477463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.477692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.477794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.477973] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.478091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.478154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.478308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.478387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.478563] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.478657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.478717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.478856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.478930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.479024] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f04eb8e-010b-4598-8810-4e9786a6ac73 is going to be updated. [ 1304.480623] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.506536] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.506741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.506741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.506947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.507116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.507290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.732716] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.733016] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.733253] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.733625] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.733873] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.734082] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 90178801-6693-4147-a140-74bc27ea5e82 not found, creating... [ 1304.734388] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.734594] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.734854] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.735087] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.735221] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.735608] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.735788] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.735913] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.736261] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.736483] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.736891] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 90178801-6693-4147-a140-74bc27ea5e82 is going to be created. [ 1304.750914] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.751154] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-971" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.751320] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-971" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.751685] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-971" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.752012] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.752273] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.752416] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.752743] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.752899] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.753126] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.753245] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1304.753361] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1304.753478] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1304.753621] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.753813] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1304.753983] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1304.757913] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.758222] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.758286] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.758499] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.758733] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.758977] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.777109] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1304.777352] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1304.777545] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1304.777810] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-971" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.778232] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-106348cd-867f-4d9a-8f0d-2af74b216909 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.778469] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-106348cd-867f-4d9a-8f0d-2af74b216909" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.778661] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-106348cd-867f-4d9a-8f0d-2af74b216909" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.778943] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-106348cd-867f-4d9a-8f0d-2af74b216909" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.779163] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('106348cd-867f-4d9a-8f0d-2af74b216909',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.870453] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.870667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.870727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.871017] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.871128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.871347] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.871450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.871546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.871724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.871802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.871910] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35f81967-0f86-4790-a162-021bab0aad8d already deleted. [ 1304.872048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.983289] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.285023] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.285023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.285023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.285023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.285023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.285023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 106348cd-867f-4d9a-8f0d-2af74b216909 not found, creating... [ 1305.285023] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.285023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.285023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.285023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.285023] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.285528] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.285528] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.285528] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.285528] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.285528] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.285899] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 106348cd-867f-4d9a-8f0d-2af74b216909 is going to be created. [ 1305.309503] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.309503] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.309503] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.309503] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.309503] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.309503] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-106348cd-867f-4d9a-8f0d-2af74b216909" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.473795] env[69756]: INFO networking_nsxv3.common.synchronization [req-af7f6943-d218-49c1-9722-d899f1201f3a req-f1fa15ff-2451-4f71-bf89-5eee5b3e9cb0 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1305.474013] env[69756]: INFO networking_nsxv3.common.synchronization [req-af7f6943-d218-49c1-9722-d899f1201f3a req-f1fa15ff-2451-4f71-bf89-5eee5b3e9cb0 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1305.475146] env[69756]: INFO networking_nsxv3.common.synchronization [req-af7f6943-d218-49c1-9722-d899f1201f3a req-f1fa15ff-2451-4f71-bf89-5eee5b3e9cb0 service nova] Enqueued Resource ID: 90178801-6693-4147-a140-74bc27ea5e82 with Priority: HIGHEST for action port [ 1305.475146] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1305.475146] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1305.475146] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90178801-6693-4147-a140-74bc27ea5e82 with Priority: HIGHEST for action port [ 1305.475927] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.476074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.476144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.476359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.476456] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.477360] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.480915] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.480915] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.480915] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-90178801-6693-4147-a140-74bc27ea5e82 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.480915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.480915] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90178801-6693-4147-a140-74bc27ea5e82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.485431] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.485613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.485613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.485767] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.485851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.485946] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c14839ba-8bdf-4b61-a062-7509aa291e61 is going to be created. [ 1305.525583] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.525761] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.525875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.526132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.526556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.540404] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: UNINITIALIZED for 2s [ 1305.983353] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.983821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.983821] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.984816] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90178801-6693-4147-a140-74bc27ea5e82 with status ACTIVE [ 1305.985030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.985162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.985231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.985493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.985590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.986022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.986391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.986477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.986686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.986895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.987022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.987154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.987210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.987639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.987639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.987639] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90178801-6693-4147-a140-74bc27ea5e82 is going to be updated. [ 1306.011641] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.011803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.012177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.012442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.012597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.012806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.074804] env[69756]: INFO networking_nsxv3.common.synchronization [req-1e652a5e-e72e-41e6-905f-1e5ba1f4d3a0 req-31faae89-6667-47cc-908b-cc1ef3c55a81 service nova] Enqueued Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGHEST for action security_group_rules [ 1306.074960] env[69756]: INFO networking_nsxv3.common.synchronization [req-1e652a5e-e72e-41e6-905f-1e5ba1f4d3a0 req-31faae89-6667-47cc-908b-cc1ef3c55a81 service nova] Enqueued Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGHEST for action security_group_members [ 1306.075114] env[69756]: INFO networking_nsxv3.common.synchronization [req-1e652a5e-e72e-41e6-905f-1e5ba1f4d3a0 req-31faae89-6667-47cc-908b-cc1ef3c55a81 service nova] Enqueued Resource ID: 106348cd-867f-4d9a-8f0d-2af74b216909 with Priority: HIGHEST for action port [ 1306.075340] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGHEST for action security_group_rules [ 1306.075466] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGHEST for action security_group_members [ 1306.075563] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 106348cd-867f-4d9a-8f0d-2af74b216909 with Priority: HIGHEST for action port [ 1306.076263] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35f81967-0f86-4790-a162-021bab0aad8d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.076432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.076468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.076720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.076807] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35f81967-0f86-4790-a162-021bab0aad8d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.077670] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f81967-0f86-4790-a162-021bab0aad8d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.077768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.077839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.078015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.078168] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.078265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.078326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.078467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.078554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.078646] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35f81967-0f86-4790-a162-021bab0aad8d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.079553] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-106348cd-867f-4d9a-8f0d-2af74b216909 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.079694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-106348cd-867f-4d9a-8f0d-2af74b216909" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.079795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-106348cd-867f-4d9a-8f0d-2af74b216909" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.080037] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-106348cd-867f-4d9a-8f0d-2af74b216909" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.080160] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('106348cd-867f-4d9a-8f0d-2af74b216909',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.490268] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.582124] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35f81967-0f86-4790-a162-021bab0aad8d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.583286] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f81967-0f86-4790-a162-021bab0aad8d taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.583405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.583544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 106348cd-867f-4d9a-8f0d-2af74b216909 with status ACTIVE [ 1306.583804] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.583893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.583937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.584148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.584236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.584395] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.584488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.584547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.584708] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.584783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.585012] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.585508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.585596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.585753] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.585827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.585916] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 106348cd-867f-4d9a-8f0d-2af74b216909 is going to be updated. [ 1306.609716] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.609716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.609716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.609716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.609716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.609716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-106348cd-867f-4d9a-8f0d-2af74b216909" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.992864] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.993245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.993245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.993322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.993447] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.993525] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1307.025726] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.025862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.025952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.026247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.026435] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.035417] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1307.088031] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35f81967-0f86-4790-a162-021bab0aad8d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.554651] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: SUCCESS [ 1307.554891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.555065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.555341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.555500] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.555614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.555684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.555831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.555904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.556015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.556099] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.590120] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.590332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.590407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.590612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.590744] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.590790] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35f81967-0f86-4790-a162-021bab0aad8d is going to be created. [ 1307.621451] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.621682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.621729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.622009] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.622187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.633932] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35f81967-0f86-4790-a162-021bab0aad8d in Status: UNINITIALIZED for 2s [ 1308.059766] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.562907] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c14839ba-8bdf-4b61-a062-7509aa291e61: rpc.has_security_group_logging(os_id): False [ 1308.587065] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.587065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.587065] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.587318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.587395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.587636] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.587738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.587802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.587953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.588041] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.588372] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c14839ba-8bdf-4b61-a062-7509aa291e61 is going to be created. [ 1308.663743] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.663935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.663935] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.664205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.664434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.679722] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: IN_PROGRESS for 2s [ 1309.045502] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1309.045687] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.045965] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.046219] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.046443] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.046592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.046683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.046873] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.046998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.047067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.047159] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.550645] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.550977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.550977] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.551258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.551455] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.551587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.551658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.551852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.551951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.552057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.552336] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.552336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.552421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.552605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.552751] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.552864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.553215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.553215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.553215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.553364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.553401] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.571877] env[69756]: INFO networking_nsxv3.common.synchronization [req-9b867b4f-5808-4cf0-a66e-b8a4f9a3a1b8 req-dd40cc67-69a7-42c0-b990-a402f152fb1c tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_members [ 1309.572448] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGHEST for action security_group_members [ 1309.573134] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.573265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.573329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.573593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.573797] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.573879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.573958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.574161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.574305] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.574366] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.645657] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35f81967-0f86-4790-a162-021bab0aad8d in Status: SUCCESS [ 1309.645899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.646091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.646346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.646545] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.646665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.647160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.647160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.647160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.647160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.647160] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35f81967-0f86-4790-a162-021bab0aad8d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.056154] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77ecb29c-d932-487b-b95d-59676b2a2f50: rpc.has_security_group_logging(os_id): False [ 1310.074526] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.074729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.074937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.075172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.075417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.075697] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.075804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.075923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.076491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.076491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.076629] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.076771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.076917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.077080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.077195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.077452] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.077579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.077666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.077838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.077942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.078065] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1310.079277] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.079434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.079526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.079781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.079910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.080504] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.080504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.080504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.080504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.080946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.080946] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 is going to be updated. [ 1310.123173] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.123350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.123391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.123600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.123754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.132790] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 in Status: IN_PROGRESS for 2s [ 1310.149413] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f81967-0f86-4790-a162-021bab0aad8d taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.149585] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.149637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.149878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.150060] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.150162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.150220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.150370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.150456] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.150545] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.150693] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f81967-0f86-4790-a162-021bab0aad8d taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.150798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.150842] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.150975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.151123] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.151213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.151266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.151403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.151477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.151556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.151651] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35f81967-0f86-4790-a162-021bab0aad8d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.270382] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.270382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.270382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.270635] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.270750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.285525] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1310.653939] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35f81967-0f86-4790-a162-021bab0aad8d: rpc.has_security_group_logging(os_id): False [ 1310.673143] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.673143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.673143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.673391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.673391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.673532] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.673647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.673796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.673897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.673973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.674187] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.674353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.674418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.674564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.674640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.674834] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.674930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.674990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.675146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.675223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.675309] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35f81967-0f86-4790-a162-021bab0aad8d is going to be created. [ 1310.694493] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: SUCCESS [ 1310.694717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.751176] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.751176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.751176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.751409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.751664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.770809] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35f81967-0f86-4790-a162-021bab0aad8d in Status: IN_PROGRESS for 2s [ 1311.814976] env[69756]: INFO networking_nsxv3.common.synchronization [req-40a893bb-6941-4256-92e9-2020b38bb675 req-a3666755-c341-460d-993f-05d7d3be77f8 tempest-VolumesAdminNegativeTest-1357987219 tempest-VolumesAdminNegativeTest-1357987219-project-member] Enqueued Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_members [ 1311.815635] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGHEST for action security_group_members [ 1311.815968] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76720d0-5804-46fa-8a2f-21842f720546 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.819294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.819294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.819294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.819294] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.819294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.819294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.819294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.819294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.819294] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.145439] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 in Status: IN_PROGRESS for 4s [ 1312.299617] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1312.299617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.324046] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.324046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.324046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.324046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.344261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.344261] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.344261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.344261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.344565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.344565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.344565] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76720d0-5804-46fa-8a2f-21842f720546 is going to be updated. [ 1312.372955] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.372955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.372955] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.373260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.373401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.383291] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76720d0-5804-46fa-8a2f-21842f720546 in Status: IN_PROGRESS for 2s [ 1312.785051] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35f81967-0f86-4790-a162-021bab0aad8d in Status: SUCCESS [ 1312.785218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.156013] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 in Status: SUCCESS [ 1314.156317] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 deletion is rescheduled due to dependency. [ 1314.156317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.392948] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76720d0-5804-46fa-8a2f-21842f720546 in Status: SUCCESS [ 1314.393129] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76720d0-5804-46fa-8a2f-21842f720546 deletion is rescheduled due to dependency. [ 1314.393249] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.147896] env[69756]: INFO networking_nsxv3.common.synchronization [None req-257d81b8-4abf-41b1-8521-8e3f8bb0be71 tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_rules [ 1316.148404] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_rules [ 1316.148706] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-467656a2-9495-4232-a9a3-281d06de34c1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.148829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.148887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.149170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.149251] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.241879] env[69756]: INFO networking_nsxv3.common.synchronization [None req-a4b1efac-a2d1-4630-b7fe-c0185312a457 tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_rules [ 1316.242429] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_rules [ 1316.242778] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-467656a2-9495-4232-a9a3-281d06de34c1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.242875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.670754] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.671532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.671532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.671532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.671532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.671831] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 467656a2-9495-4232-a9a3-281d06de34c1 already deleted. [ 1316.672160] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.672355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.672798] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.672798] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.193874] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.194270] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.194270] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.194350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.194405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.194510] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 467656a2-9495-4232-a9a3-281d06de34c1 already deleted. [ 1317.194594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.243485] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.244112] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.114018] env[69756]: INFO networking_nsxv3.common.synchronization [req-7235c529-cd2b-4e84-89fa-eaf00717d7a3 req-b62a78f5-44e9-4ec9-a176-fad8df776007 tempest-InstanceActionsNegativeTestJSON-2097532457 tempest-InstanceActionsNegativeTestJSON-2097532457-project-member] Enqueued Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGHEST for action security_group_members [ 1322.116056] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGHEST for action security_group_members [ 1322.117297] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f81967-0f86-4790-a162-021bab0aad8d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.118348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.118348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.118348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.118348] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.118348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.118630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.119871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.119871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.120179] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35f81967-0f86-4790-a162-021bab0aad8d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.591328] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.591328] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.591606] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.591768] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.592199] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.592400] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.592760] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.593088] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.593322] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.595419] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1322.595419] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1322.595419] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1322.595419] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1322.595419] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1322.595419] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1322.595419] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1322.622611] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1322.623321] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1322.623321] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1322.623321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-978" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.623916] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-90178801-6693-4147-a140-74bc27ea5e82 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.623916] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.624161] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.624352] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.625076] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90178801-6693-4147-a140-74bc27ea5e82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.626047] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.626229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.626351] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.626646] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.626646] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.626920] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.627064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.627153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.627405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.627405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.627599] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35f81967-0f86-4790-a162-021bab0aad8d is going to be updated. [ 1322.658242] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.658400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.658486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.658667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.658804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.668622] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35f81967-0f86-4790-a162-021bab0aad8d in Status: IN_PROGRESS for 2s [ 1322.960823] env[69756]: INFO networking_nsxv3.common.synchronization [req-b8208d82-2143-4c3c-90b0-33b8110891e9 req-7eec99f5-47b9-4e22-93dc-2b5bb2ccfd7c tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_members [ 1322.961456] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_members [ 1322.962046] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-467656a2-9495-4232-a9a3-281d06de34c1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.966580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.966580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.966953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.967194] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.967741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.967741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.968119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.968119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.968258] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.130645] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.130966] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.131326] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.132447] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.132637] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.133158] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.133450] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.133676] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.134211] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.134479] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.135656] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.135892] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.136086] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.136466] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.136713] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.136960] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 90178801-6693-4147-a140-74bc27ea5e82 is going to be updated. [ 1323.162747] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.164020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.164020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.164020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.164020] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.164235] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.307124] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.307226] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.307325] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.307599] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.307949] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.308223] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.308431] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.308771] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.309622] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.309622] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1323.309622] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1323.309786] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1323.309974] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1323.310375] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1323.310440] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1323.310731] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1323.338164] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1323.338386] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1323.338537] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1323.338726] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-669" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.339350] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-d08dc8d6-d71f-4db2-936e-5a39255e5c55 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.339350] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-d08dc8d6-d71f-4db2-936e-5a39255e5c55" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.339529] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-d08dc8d6-d71f-4db2-936e-5a39255e5c55" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.339730] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-d08dc8d6-d71f-4db2-936e-5a39255e5c55" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.339877] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d08dc8d6-d71f-4db2-936e-5a39255e5c55',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.469971] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.470228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.470299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.470533] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.470656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.470953] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.471053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.471053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.471238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.471328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.471415] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 467656a2-9495-4232-a9a3-281d06de34c1 already deleted. [ 1323.471503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.846072] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.846072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.846072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.846072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.846072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.846072] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port d08dc8d6-d71f-4db2-936e-5a39255e5c55 not found, creating... [ 1323.846072] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.846072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.846072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.846072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.846072] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.846970] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.846970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.846970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.846970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.846970] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.846970] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: d08dc8d6-d71f-4db2-936e-5a39255e5c55 is going to be created. [ 1323.871156] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.871156] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.871156] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.871156] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.871368] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.872372] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-d08dc8d6-d71f-4db2-936e-5a39255e5c55" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.036333] env[69756]: INFO networking_nsxv3.common.synchronization [req-17590e86-f6ff-4530-a195-3dcd89cc3901 req-3ca598c2-0dba-4913-9759-cf12aa629a37 tempest-DeleteServersTestJSON-372770724 tempest-DeleteServersTestJSON-372770724-project-member] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1324.036590] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGHEST for action security_group_members [ 1324.036893] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.037054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.037127] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.037336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.038972] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.038972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.038972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.038972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.038972] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.038972] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.073822] env[69756]: INFO networking_nsxv3.common.synchronization [req-5857f7ae-b6b6-430b-bfe4-6f11674109fa req-e493a122-dcc8-435a-8dbf-cf44a50153e2 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1324.073822] env[69756]: INFO networking_nsxv3.common.synchronization [req-5857f7ae-b6b6-430b-bfe4-6f11674109fa req-e493a122-dcc8-435a-8dbf-cf44a50153e2 service nova] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1324.073822] env[69756]: INFO networking_nsxv3.common.synchronization [req-5857f7ae-b6b6-430b-bfe4-6f11674109fa req-e493a122-dcc8-435a-8dbf-cf44a50153e2 service nova] Enqueued Resource ID: 90178801-6693-4147-a140-74bc27ea5e82 with Priority: HIGHEST for action port [ 1324.074064] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_rules [ 1324.074064] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1324.074180] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90178801-6693-4147-a140-74bc27ea5e82 with Priority: HIGHEST for action port [ 1324.075300] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.075300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.075300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.075300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.075300] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.076685] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.076685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.076685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.076685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.076685] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.076685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.076685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.076685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.077188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.077188] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.077711] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-90178801-6693-4147-a140-74bc27ea5e82 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.079047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.079047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.079047] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.079047] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90178801-6693-4147-a140-74bc27ea5e82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.541163] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.541398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.541398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.541610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.541698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.541897] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.541989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.542062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.542211] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.542284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.542368] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be updated. [ 1324.573365] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.573508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.573577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.573866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.574043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.580390] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.580390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.580390] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.581421] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90178801-6693-4147-a140-74bc27ea5e82 with status ACTIVE [ 1324.581627] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.581743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.581820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.582112] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.582221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.582445] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.582512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.582560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.582891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.582891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.583122] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.583230] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.583308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.583437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.583511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.583598] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90178801-6693-4147-a140-74bc27ea5e82 is going to be updated. [ 1324.585683] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: IN_PROGRESS for 2s [ 1324.607492] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.607633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.607709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.607923] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.608077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.608234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90178801-6693-4147-a140-74bc27ea5e82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.679081] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35f81967-0f86-4790-a162-021bab0aad8d in Status: SUCCESS [ 1324.679272] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35f81967-0f86-4790-a162-021bab0aad8d deletion is rescheduled due to dependency. [ 1324.679364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.753353] env[69756]: INFO networking_nsxv3.common.synchronization [req-b8208d82-2143-4c3c-90b0-33b8110891e9 req-b3309da6-1dd4-46fe-8c64-736e66117913 service nova] Enqueued Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_rules [ 1324.753353] env[69756]: INFO networking_nsxv3.common.synchronization [req-b8208d82-2143-4c3c-90b0-33b8110891e9 req-b3309da6-1dd4-46fe-8c64-736e66117913 service nova] Enqueued Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_members [ 1324.753353] env[69756]: INFO networking_nsxv3.common.synchronization [req-b8208d82-2143-4c3c-90b0-33b8110891e9 req-b3309da6-1dd4-46fe-8c64-736e66117913 service nova] Enqueued Resource ID: d08dc8d6-d71f-4db2-936e-5a39255e5c55 with Priority: HIGHEST for action port [ 1324.753353] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_rules [ 1324.753353] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_members [ 1324.753788] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08dc8d6-d71f-4db2-936e-5a39255e5c55 with Priority: HIGHEST for action port [ 1324.755033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-467656a2-9495-4232-a9a3-281d06de34c1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.755180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.755233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.755433] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.755536] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.756366] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-467656a2-9495-4232-a9a3-281d06de34c1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.756474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.756541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.756779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.756854] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.756947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.757014] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.757158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.757245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.757336] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.758215] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-d08dc8d6-d71f-4db2-936e-5a39255e5c55 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.758215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d08dc8d6-d71f-4db2-936e-5a39255e5c55" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.758478] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d08dc8d6-d71f-4db2-936e-5a39255e5c55" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.758478] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d08dc8d6-d71f-4db2-936e-5a39255e5c55" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.758478] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d08dc8d6-d71f-4db2-936e-5a39255e5c55',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.987165] env[69756]: INFO networking_nsxv3.common.synchronization [req-ec905a50-c192-4eb6-9d9e-ad0ff84f2461 req-9de201c6-967c-4ad3-a8ac-0613edc00f0f tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_members [ 1324.987701] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGHEST for action security_group_members [ 1324.988051] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.988179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.988239] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.988491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.988613] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.988774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.988774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.989691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.989691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.989691] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.083215] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.260020] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.263162] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-467656a2-9495-4232-a9a3-281d06de34c1 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.263276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.263918] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d08dc8d6-d71f-4db2-936e-5a39255e5c55 with status ACTIVE [ 1325.264679] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.264679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.265636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.265636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.265636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.265636] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.265803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.265838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.266083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.266214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.267240] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.267240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.267240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.267444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.267570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.268224] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d08dc8d6-d71f-4db2-936e-5a39255e5c55 is going to be updated. [ 1325.292221] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.292417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.292459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.292639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.292859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.293052] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d08dc8d6-d71f-4db2-936e-5a39255e5c55" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.358606] env[69756]: INFO networking_nsxv3.common.synchronization [None req-89b1e47d-654b-4415-a4b6-e77faf4ab0bb None None] Enqueued Resource ID: a0452913-c235-4a63-8d51-751333193f89 with Priority: HIGHEST for action port [ 1325.359290] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0452913-c235-4a63-8d51-751333193f89 with Priority: HIGHEST for action port [ 1325.359707] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0452913-c235-4a63-8d51-751333193f89 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.359845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0452913-c235-4a63-8d51-751333193f89" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.359894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0452913-c235-4a63-8d51-751333193f89" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.360365] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0452913-c235-4a63-8d51-751333193f89" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.360464] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0452913-c235-4a63-8d51-751333193f89',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.491275] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.491435] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.491610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.491713] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.491804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.492014] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.492115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.492176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.492328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.492406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.492492] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 is going to be updated. [ 1325.537295] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.537506] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.537634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.537893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.538784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.553136] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 in Status: IN_PROGRESS for 2s [ 1325.587342] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.587342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.587342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.587495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.588309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.588309] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1325.621117] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.621117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.621117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.625300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.625517] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.641407] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1325.766275] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.862334] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0452913-c235-4a63-8d51-751333193f89 [ 1325.862698] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.862914] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.862988] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.863244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.863906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.863906] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0452913-c235-4a63-8d51-751333193f89 already deleted. [ 1325.863906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0452913-c235-4a63-8d51-751333193f89" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.270130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.270476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.270476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.270640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.270681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.270779] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 467656a2-9495-4232-a9a3-281d06de34c1 is going to be created. [ 1326.296398] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.297417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.297417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.297417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.297864] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.309991] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 467656a2-9495-4232-a9a3-281d06de34c1 in Status: UNINITIALIZED for 2s [ 1326.595760] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d711ed5-98da-4810-9f03-9148ad645008 in Status: SUCCESS [ 1326.595926] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 deletion is rescheduled due to dependency. [ 1326.596062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.566739] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 in Status: SUCCESS [ 1327.567391] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 deletion is rescheduled due to dependency. [ 1327.568413] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.650969] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1327.651195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.651410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.651689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.651926] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.652061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.652128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.652285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.652366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.652451] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.652539] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.154927] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.155118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.155216] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.155484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.155578] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.155678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.155759] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.155943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.156054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.156054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.156230] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.156320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.156320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.156320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.156320] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.156320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.156320] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.158416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.158416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.158416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.158416] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.324307] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 467656a2-9495-4232-a9a3-281d06de34c1 in Status: SUCCESS [ 1328.324307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.324307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.324307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.324307] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.324307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.324307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.324307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.324307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.324307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.324307] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.659695] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77ecb29c-d932-487b-b95d-59676b2a2f50: rpc.has_security_group_logging(os_id): False [ 1328.680605] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.680605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.680605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.680827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.680827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.680969] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.681087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.681149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.681329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.681367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.681548] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.681643] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.681704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.681880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.681919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.682109] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.682205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.682265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.682405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.682480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.682565] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1328.755936] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.756682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.756682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.756682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.757035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.775021] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1328.827382] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.330168] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 467656a2-9495-4232-a9a3-281d06de34c1: rpc.has_security_group_logging(os_id): False [ 1329.348262] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.348473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.348473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.348675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.348762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.349557] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.349557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.349557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.349557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.349557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.349557] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 467656a2-9495-4232-a9a3-281d06de34c1 is going to be created. [ 1329.412847] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.413531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.413995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.415621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.415882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.429909] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 467656a2-9495-4232-a9a3-281d06de34c1 in Status: IN_PROGRESS for 2s [ 1330.360066] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.360361] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1330.788503] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1330.788738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.444230] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 467656a2-9495-4232-a9a3-281d06de34c1 in Status: SUCCESS [ 1331.444567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.361383] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.362046] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1339.441542] env[69756]: INFO networking_nsxv3.common.synchronization [req-39484a52-436b-4c45-bfc3-f7d58d2bd4a8 req-1dbea90d-64c5-4335-aad5-d136d47643eb tempest-ListServerFiltersTestJSON-164164359 tempest-ListServerFiltersTestJSON-164164359-project-member] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1339.442339] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1339.442547] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.442547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.442791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.443099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.443099] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.443251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.443251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.443352] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.443446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.443544] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.757943] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.758167] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.758297] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.758658] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.758975] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.759325] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.759535] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.759910] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.760195] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.760512] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1339.760642] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1339.760859] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1339.761017] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1339.761138] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1339.761259] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1339.761402] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1339.787106] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1339.787106] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1339.787106] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1339.787106] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.787106] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-f8c76892-8b04-44c0-9c1a-be2a193dcf23 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.787106] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-f8c76892-8b04-44c0-9c1a-be2a193dcf23" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.787106] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-f8c76892-8b04-44c0-9c1a-be2a193dcf23" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.787106] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-f8c76892-8b04-44c0-9c1a-be2a193dcf23" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.787106] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8c76892-8b04-44c0-9c1a-be2a193dcf23',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.945936] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.946145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.946197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.946385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.946476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.946680] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.946778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.946841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.947262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.947481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.947570] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 already deleted. [ 1339.947630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.290751] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.291085] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.291238] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.291664] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.291855] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.292037] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port f8c76892-8b04-44c0-9c1a-be2a193dcf23 not found, creating... [ 1340.292317] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.292484] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.292611] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.292861] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.293051] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.293415] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.293639] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.293786] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.294076] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.294317] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.294560] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: f8c76892-8b04-44c0-9c1a-be2a193dcf23 is going to be created. [ 1340.318779] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.319048] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.319204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.319488] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.319797] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.320063] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-f8c76892-8b04-44c0-9c1a-be2a193dcf23" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.561085] env[69756]: INFO networking_nsxv3.common.synchronization [req-ca9a73fd-b814-456d-b6ef-d399d0bc7377 req-80d105ba-c0d0-4cf9-9d74-2a1371044718 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1340.563723] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1340.563723] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.563723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.563723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.563723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.563723] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.563723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.563723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.564207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.564207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.564207] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.063563] env[69756]: INFO networking_nsxv3.common.synchronization [req-39484a52-436b-4c45-bfc3-f7d58d2bd4a8 req-d5c6649b-fced-4edc-8ec5-733108e0bf77 service nova] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_rules [ 1341.063749] env[69756]: INFO networking_nsxv3.common.synchronization [req-39484a52-436b-4c45-bfc3-f7d58d2bd4a8 req-d5c6649b-fced-4edc-8ec5-733108e0bf77 service nova] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1341.063894] env[69756]: INFO networking_nsxv3.common.synchronization [req-39484a52-436b-4c45-bfc3-f7d58d2bd4a8 req-d5c6649b-fced-4edc-8ec5-733108e0bf77 service nova] Enqueued Resource ID: f8c76892-8b04-44c0-9c1a-be2a193dcf23 with Priority: HIGHEST for action port [ 1341.064143] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_rules [ 1341.064270] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1341.064367] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c76892-8b04-44c0-9c1a-be2a193dcf23 with Priority: HIGHEST for action port [ 1341.064918] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.065741] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.065854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.066497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.066497] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.067079] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.067224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.067258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.067450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.067579] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.067675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.067732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.068012] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.068012] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.068120] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.068944] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8c76892-8b04-44c0-9c1a-be2a193dcf23 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.069071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8c76892-8b04-44c0-9c1a-be2a193dcf23" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.069135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8c76892-8b04-44c0-9c1a-be2a193dcf23" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.069465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8c76892-8b04-44c0-9c1a-be2a193dcf23" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.069547] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8c76892-8b04-44c0-9c1a-be2a193dcf23',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.070607] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.571488] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.571818] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.571865] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.573085] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8c76892-8b04-44c0-9c1a-be2a193dcf23 with status ACTIVE [ 1341.573249] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.573417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.573417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.573663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.573769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.573905] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.573994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.574060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.574222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.574292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.575312] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.575312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.575312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.575312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.575312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.575312] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8c76892-8b04-44c0-9c1a-be2a193dcf23 is going to be updated. [ 1341.576262] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.599998] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.600176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.600229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.600438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.600577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.600751] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8c76892-8b04-44c0-9c1a-be2a193dcf23" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.818575] env[69756]: INFO networking_nsxv3.common.synchronization [req-2c06e849-9743-4966-8ddf-18925ccd1e7d req-7a55f99f-dbd7-433b-b679-be8798cef694 tempest-ListServerFiltersTestJSON-164164359 tempest-ListServerFiltersTestJSON-164164359-project-member] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1341.818575] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1341.818575] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.818575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.078329] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.079931] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.081178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.081178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.081178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.081178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.081178] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 is going to be updated. [ 1342.130106] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.130251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.130324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.130538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.130688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.139985] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: IN_PROGRESS for 2s [ 1342.212665] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.212929] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.213096] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.213380] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.213653] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.213843] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.213973] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.214225] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.214381] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.214601] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1342.214724] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1342.214905] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1342.215048] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1342.215202] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1342.215291] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1342.215433] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1342.241479] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1342.241700] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1342.241793] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1342.241990] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.242332] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.242496] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.242698] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.243170] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.243914] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c218d34-dc5f-4dde-9207-e5d7b3b6e1da',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.580659] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.580659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.580659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.580659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.580659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.580659] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be created. [ 1342.609210] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.609370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.609455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.609794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.609940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.620637] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: UNINITIALIZED for 2s [ 1342.746681] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.746681] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.746681] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.747171] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.747171] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.747171] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 2c218d34-dc5f-4dde-9207-e5d7b3b6e1da not found, creating... [ 1342.747460] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.747622] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.747750] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.747979] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.748139] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.748425] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.748590] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.748712] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.748926] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.749082] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.749229] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 2c218d34-dc5f-4dde-9207-e5d7b3b6e1da is going to be created. [ 1342.769477] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.769708] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.769810] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.770112] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.770379] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.770627] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.770698] env[69756]: INFO networking_nsxv3.common.synchronization [req-2c06e849-9743-4966-8ddf-18925ccd1e7d req-af306db6-9c7a-4d42-90da-a17617d3585a service nova] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_rules [ 1343.770698] env[69756]: INFO networking_nsxv3.common.synchronization [req-2c06e849-9743-4966-8ddf-18925ccd1e7d req-af306db6-9c7a-4d42-90da-a17617d3585a service nova] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1343.770698] env[69756]: INFO networking_nsxv3.common.synchronization [req-2c06e849-9743-4966-8ddf-18925ccd1e7d req-af306db6-9c7a-4d42-90da-a17617d3585a service nova] Enqueued Resource ID: 2c218d34-dc5f-4dde-9207-e5d7b3b6e1da with Priority: HIGHEST for action port [ 1343.770698] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_rules [ 1343.771160] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1343.771160] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c218d34-dc5f-4dde-9207-e5d7b3b6e1da with Priority: HIGHEST for action port [ 1343.771358] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.771438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.771907] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.772038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.772334] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.772530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.772605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.772956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.773119] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c218d34-dc5f-4dde-9207-e5d7b3b6e1da',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.151581] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: IN_PROGRESS for 4s [ 1344.278023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c218d34-dc5f-4dde-9207-e5d7b3b6e1da with status ACTIVE [ 1344.278023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.278023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.278023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.278023] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.278023] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c218d34-dc5f-4dde-9207-e5d7b3b6e1da is going to be updated. [ 1344.301330] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.301330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.301330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.301682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.301742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.302931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c218d34-dc5f-4dde-9207-e5d7b3b6e1da" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.310579] env[69756]: INFO networking_nsxv3.common.synchronization [req-84bd3a89-3778-4fd4-abb4-cb1c2b9882c5 req-a4472a5b-71ad-4ebf-a2de-330e08196438 tempest-ListServerFiltersTestJSON-164164359 tempest-ListServerFiltersTestJSON-164164359-project-member] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1344.310579] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1344.310579] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.310579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.591621] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.591824] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.591954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.592257] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.592522] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.592681] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.592802] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.593108] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.593267] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.593564] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1344.593699] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1344.593819] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1344.594092] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1344.594243] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1344.594360] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1344.594495] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1344.612976] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1344.613185] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1344.613333] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1344.613511] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-647" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.613817] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-19b7e502-16a6-4b1b-8ab0-7acef855600e taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.614091] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-19b7e502-16a6-4b1b-8ab0-7acef855600e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.614240] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-19b7e502-16a6-4b1b-8ab0-7acef855600e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.614549] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-19b7e502-16a6-4b1b-8ab0-7acef855600e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.614691] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19b7e502-16a6-4b1b-8ab0-7acef855600e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.632298] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1344.632506] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.633059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.633294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.633495] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.633614] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.633684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.633920] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.633987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.634157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.634298] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.635143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.635325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.635485] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.635592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.635659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.635805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.635887] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.635979] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.116694] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.117082] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.117195] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.117517] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.117737] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.117978] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 19b7e502-16a6-4b1b-8ab0-7acef855600e not found, creating... [ 1345.118367] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.118605] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.118759] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.119154] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.119320] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.119695] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.119921] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.120404] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.120404] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.120578] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.120741] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 19b7e502-16a6-4b1b-8ab0-7acef855600e is going to be created. [ 1345.137588] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.137793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.138079] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.146290] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.146668] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.146905] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.147384] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.147791] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.148198] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-19b7e502-16a6-4b1b-8ab0-7acef855600e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.643226] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.859230] env[69756]: INFO networking_nsxv3.common.synchronization [req-84bd3a89-3778-4fd4-abb4-cb1c2b9882c5 req-33b81133-92f8-46dd-b793-bd6558efcfda service nova] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_rules [ 1345.859230] env[69756]: INFO networking_nsxv3.common.synchronization [req-84bd3a89-3778-4fd4-abb4-cb1c2b9882c5 req-33b81133-92f8-46dd-b793-bd6558efcfda service nova] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1345.859230] env[69756]: INFO networking_nsxv3.common.synchronization [req-84bd3a89-3778-4fd4-abb4-cb1c2b9882c5 req-33b81133-92f8-46dd-b793-bd6558efcfda service nova] Enqueued Resource ID: 19b7e502-16a6-4b1b-8ab0-7acef855600e with Priority: HIGHEST for action port [ 1345.859638] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_rules [ 1345.859789] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1345.859885] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19b7e502-16a6-4b1b-8ab0-7acef855600e with Priority: HIGHEST for action port [ 1345.860231] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.860333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.860569] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.860650] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.860874] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-19b7e502-16a6-4b1b-8ab0-7acef855600e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.860985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19b7e502-16a6-4b1b-8ab0-7acef855600e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.861064] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19b7e502-16a6-4b1b-8ab0-7acef855600e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.861293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19b7e502-16a6-4b1b-8ab0-7acef855600e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.861412] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19b7e502-16a6-4b1b-8ab0-7acef855600e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.145769] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.146147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.146147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.146357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.146473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.146602] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be updated. [ 1346.161442] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: SUCCESS [ 1346.161650] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.183259] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.183397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.183397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.183621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.183775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.194308] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1346.363689] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19b7e502-16a6-4b1b-8ab0-7acef855600e with status ACTIVE [ 1346.365847] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.365847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.365847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.365847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.366113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.366146] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.366302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.366420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.367255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.367255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.367255] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.367255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.367255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.367626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.367626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.367626] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19b7e502-16a6-4b1b-8ab0-7acef855600e is going to be updated. [ 1346.391640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.391640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.391807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.392008] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.392191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.392358] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19b7e502-16a6-4b1b-8ab0-7acef855600e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.090650] env[69756]: INFO networking_nsxv3.common.synchronization [req-3569a1a8-bae3-41ea-b32d-1490790990ff req-2ad65e3b-c6cd-4bfc-bcf3-89d9aca8a953 tempest-AttachVolumeTestJSON-1233597287 tempest-AttachVolumeTestJSON-1233597287-project-member] Enqueued Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_members [ 1348.091321] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGHEST for action security_group_members [ 1348.091674] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.091807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.091878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.095119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.099027] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.099027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.099027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.099027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.099027] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.099027] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.210186] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1348.213113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.213113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.213113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.213113] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.213113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.213113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.213113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.213113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.213113] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.600490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.600490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.600490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.600490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.600490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.600490] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.603020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.603020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.603020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.603020] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.603020] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 is going to be updated. [ 1348.634248] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.636669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.636899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.637476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.637762] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.646570] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 in Status: IN_PROGRESS for 2s [ 1348.715599] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.219440] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.725514] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.725847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.725847] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.726145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.726309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.726427] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be updated. [ 1349.756458] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.756458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.756458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.756720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.756846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.765865] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1350.659206] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 in Status: SUCCESS [ 1350.659618] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 deletion is rescheduled due to dependency. [ 1350.659618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.437460] env[69756]: INFO networking_nsxv3.common.synchronization [req-114d8221-a45c-4b32-9368-16312e532d10 req-ad103893-403a-42f4-b3ac-c4f46fe26026 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1351.438473] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGHEST for action security_group_members [ 1351.439241] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.439241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.439241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.441653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.441653] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.441653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.441653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.441653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.441653] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.443327] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.779025] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1351.779025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.779025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.779025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.779025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.779025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.779025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.779025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.779025] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.779025] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.946133] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.947720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.947720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.947720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.947720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.947720] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.947720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.947720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.947720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.947720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.947720] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 is going to be updated. [ 1351.981801] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.982049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.982189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.982374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.982549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.993320] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: IN_PROGRESS for 2s [ 1352.281764] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.784439] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.287440] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.287631] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.287669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.287899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.287995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.288155] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be updated. [ 1353.322090] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.322401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.322676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.323981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.323981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.334892] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1354.004205] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 in Status: SUCCESS [ 1354.005126] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 deletion is rescheduled due to dependency. [ 1354.005126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.346836] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1355.347244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.347353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.347597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.347823] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.347966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.348055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.348228] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.348311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.348419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.348605] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.348709] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.348969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.348969] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.349088] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.349168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.349229] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.349390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.349565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.349565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.349674] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.350555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.350726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.350897] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.351075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.351075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.351309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.351355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.351469] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.385151] env[69756]: INFO networking_nsxv3.common.synchronization [None req-8e6cfde8-d6ea-40f7-a571-8e21594a0c29 tempest-AttachInterfacesTestJSON-1166440747 tempest-AttachInterfacesTestJSON-1166440747-project-member] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1355.385667] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGHEST for action security_group_members [ 1355.385987] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.386130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.386197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.386481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.386654] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.386784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.386841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.387021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.387255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.387354] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.853473] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aea02386-d4f9-4c6c-b8e7-e18723540260: rpc.has_security_group_logging(os_id): False [ 1355.854778] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.876800] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.876963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.877059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.877281] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.877372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.877564] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.877700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.877736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.877863] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.877934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.878143] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.878222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.878269] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.878424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.878504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.878689] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.878778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.878869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.878984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.879176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.879296] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be created. [ 1355.890727] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.890933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.891050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.891246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.891420] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.891586] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.891697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.891786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.891974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.892061] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.892173] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be updated. [ 1355.925033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.925248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.925474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.925851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.926693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.941210] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: IN_PROGRESS for 2s [ 1355.963043] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.963043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.963309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.963454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.963748] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.995104] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1356.357113] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.864595] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.864595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.864595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.864595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.864595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.864595] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be updated. [ 1356.899026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.899026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.899026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.899026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.899026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.909732] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1357.953043] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 in Status: SUCCESS [ 1357.953372] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 deletion is rescheduled due to dependency. [ 1357.953372] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.010400] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1358.010700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.010943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.011251] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.011367] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.513701] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.513845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.919497] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1358.919815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.920060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.920268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.920795] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.920795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.920795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.920795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.921028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.921028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.921104] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.423559] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.423940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.423940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.424105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.424720] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.424856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.424937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.425159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.425221] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.425329] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.425501] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.425612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.425672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.425830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.425980] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.426088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.426184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.426298] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.426516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.426634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.426733] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.928673] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aea02386-d4f9-4c6c-b8e7-e18723540260: rpc.has_security_group_logging(os_id): False [ 1359.948460] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.948665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.948724] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.948941] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.949045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.949458] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.949458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.949458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.949589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.949589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.949818] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.949918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.949981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.950139] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.950217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.950492] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.950590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.950590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.950743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.950819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.950906] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be updated. [ 1360.033634] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.033787] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.033872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.034174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.034375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.047412] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1360.147162] env[69756]: INFO networking_nsxv3.common.synchronization [None req-65ab89c4-0dbd-4431-a528-4d38e609ba80 None None] Enqueued Resource ID: ca5cb756-717b-4931-8c58-c041e9b0e6ff with Priority: HIGHEST for action port [ 1360.147162] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca5cb756-717b-4931-8c58-c041e9b0e6ff with Priority: HIGHEST for action port [ 1360.147162] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca5cb756-717b-4931-8c58-c041e9b0e6ff taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.147162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca5cb756-717b-4931-8c58-c041e9b0e6ff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.147162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca5cb756-717b-4931-8c58-c041e9b0e6ff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.147162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca5cb756-717b-4931-8c58-c041e9b0e6ff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.147162] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca5cb756-717b-4931-8c58-c041e9b0e6ff',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.649653] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca5cb756-717b-4931-8c58-c041e9b0e6ff [ 1360.649905] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.652600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.652600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.652600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.652600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.652600] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca5cb756-717b-4931-8c58-c041e9b0e6ff already deleted. [ 1360.652600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca5cb756-717b-4931-8c58-c041e9b0e6ff" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.829186] env[69756]: INFO networking_nsxv3.common.synchronization [None req-551d5ade-e6e3-4d3a-b06d-0f41e241b1f9 None None] Enqueued Resource ID: fc7f30c0-8dc6-43f0-ab43-49757d4fecba with Priority: HIGHEST for action port [ 1361.829186] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc7f30c0-8dc6-43f0-ab43-49757d4fecba with Priority: HIGHEST for action port [ 1361.829186] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc7f30c0-8dc6-43f0-ab43-49757d4fecba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.829186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc7f30c0-8dc6-43f0-ab43-49757d4fecba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.829186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc7f30c0-8dc6-43f0-ab43-49757d4fecba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.829186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc7f30c0-8dc6-43f0-ab43-49757d4fecba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.829186] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7f30c0-8dc6-43f0-ab43-49757d4fecba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.066401] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1362.066576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.066775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.067019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.067118] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.333868] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc7f30c0-8dc6-43f0-ab43-49757d4fecba [ 1362.333868] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.333868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.333868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.333868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.333868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.333868] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc7f30c0-8dc6-43f0-ab43-49757d4fecba already deleted. [ 1362.333868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc7f30c0-8dc6-43f0-ab43-49757d4fecba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.570829] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.571097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.571154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.571359] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.571521] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.571617] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.571674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.571823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.571904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.571987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.572811] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.674481] env[69756]: INFO networking_nsxv3.common.synchronization [req-e1f0d47e-24b3-4285-908f-694c73086aa4 req-99cbd2a7-6ab1-4094-ada1-a8d0e4214b0a tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1362.675130] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1362.675130] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.675130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.675130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.675386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.675518] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.675518] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.676100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.676100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.676100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.676100] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.080134] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.085243] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.085243] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.085243] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.085243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.087801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.090247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.090247] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.179022] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.179302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.179302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.179484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.179597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.179804] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.179897] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.179971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.180166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.180295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.180346] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1363.212964] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.213315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.213412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.213657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.213971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.224876] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1363.595732] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aea02386-d4f9-4c6c-b8e7-e18723540260: rpc.has_security_group_logging(os_id): False [ 1363.616026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.616026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.616026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.616026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.616026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.616026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.616026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.616026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.616026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.616026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.616816] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.617087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.617287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.619661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.619661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.619661] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.619661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.619661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.619661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.619661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.619661] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be updated. [ 1363.685531] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.685531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.685531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.685531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.685531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.698958] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1365.238370] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1365.238662] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc deletion is rescheduled due to dependency. [ 1365.238710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.715550] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1365.715810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.217393] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-78eeff54-5a7e-45a6-aba0-c0aa112acb4e tempest-ListServersNegativeTestJSON-401732282 tempest-ListServersNegativeTestJSON-401732282-project-member] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1366.218031] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1366.218343] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.218473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.218541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.218803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.218959] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.219146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.219204] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.219367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.219450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.219544] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.524462] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.524892] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.524892] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.525154] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.525477] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.525684] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.525813] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.526080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.526244] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.526465] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1366.526584] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1366.526697] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1366.526810] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1366.526928] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1366.527049] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1366.527195] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1366.549212] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1366.549403] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1366.549551] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1366.549740] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.550081] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.550269] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.550385] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.550743] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.550875] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a7630d6-fa83-4b3a-bce1-2f56b7eb4781',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.722505] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.722678] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.722753] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.722976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.723126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.723567] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.723567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.723567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.723699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.723829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.723829] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 already deleted. [ 1366.723971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.054012] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.054192] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.054260] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.054558] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.054731] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.054907] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 4a7630d6-fa83-4b3a-bce1-2f56b7eb4781 not found, creating... [ 1367.055207] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.055408] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.055518] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.055747] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.055893] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.056205] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.056383] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.056510] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.056722] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.056860] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.057035] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 4a7630d6-fa83-4b3a-bce1-2f56b7eb4781 is going to be created. [ 1367.069156] env[69756]: INFO networking_nsxv3.common.synchronization [req-e2ecf756-2350-467b-8889-f25729782a35 req-c5ecb8cb-dc6e-4948-9d95-1ff34891bd47 tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 1367.070030] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 1367.070030] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.070240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.070240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.070340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.070502] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.070594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.070657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.070803] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.071296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.071296] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.078369] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.078668] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.078815] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.079110] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.079426] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.079613] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.576549] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.729023] env[69756]: INFO networking_nsxv3.common.synchronization [req-5ac9d07d-51b3-485b-ba91-dbd1a688fc4c req-03a3014f-5606-480f-af7f-bce261c1167b tempest-ListServerFiltersTestJSON-164164359 tempest-ListServerFiltersTestJSON-164164359-project-member] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1367.729023] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1367.729023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.729555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.729773] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.730133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.730417] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.730670] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.730836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.731180] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.731405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.731618] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.776984] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-210a53c9-8aac-4126-bd7d-6602ec3f33c4 service nova] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_rules [ 1367.776984] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-210a53c9-8aac-4126-bd7d-6602ec3f33c4 service nova] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1367.776984] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-210a53c9-8aac-4126-bd7d-6602ec3f33c4 service nova] Enqueued Resource ID: 4a7630d6-fa83-4b3a-bce1-2f56b7eb4781 with Priority: HIGHEST for action port [ 1367.777449] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_rules [ 1367.777588] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1367.777723] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7630d6-fa83-4b3a-bce1-2f56b7eb4781 with Priority: HIGHEST for action port [ 1367.778215] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.778347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.778460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.778680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.778764] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.779870] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.779870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.780118] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.780814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.780814] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.780814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.780814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.780814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.780814] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.780814] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.781826] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.782399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.782399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.782399] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.782399] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a7630d6-fa83-4b3a-bce1-2f56b7eb4781',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.078709] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.234052] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.283914] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.285033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.285177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.285512] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a7630d6-fa83-4b3a-bce1-2f56b7eb4781 with status ACTIVE [ 1368.285690] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.285819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.285893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.286119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.286288] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.286402] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.286573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.286640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.286797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.286875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.287776] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.287936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.288044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.288222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.288312] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.288403] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a7630d6-fa83-4b3a-bce1-2f56b7eb4781 is going to be updated. [ 1368.310504] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.310695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.310743] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.310927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.311124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.311279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a7630d6-fa83-4b3a-bce1-2f56b7eb4781" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.571093] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-d9315e18-6290-4715-a2f9-b71082dd450d tempest-ListServersNegativeTestJSON-401732282 tempest-ListServersNegativeTestJSON-401732282-project-member] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1368.571626] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1368.571929] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.572044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.580853] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.581389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.581389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.581389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.581670] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.581670] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b is going to be updated. [ 1368.629535] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.629755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.629755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.629954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.630123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.639639] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: IN_PROGRESS for 2s [ 1368.735981] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.785869] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.863386] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.863714] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.863887] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.864275] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.864577] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.864811] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.864973] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.865261] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.865606] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.865873] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1368.866048] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1368.866218] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1368.866365] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1368.866518] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1368.866662] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1368.866838] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1368.887029] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1368.887135] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1368.887273] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1368.887470] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.887906] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-63cbd196-515c-4f22-af11-612a555958f6 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.888028] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-63cbd196-515c-4f22-af11-612a555958f6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.888163] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-63cbd196-515c-4f22-af11-612a555958f6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.888576] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-63cbd196-515c-4f22-af11-612a555958f6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.888730] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63cbd196-515c-4f22-af11-612a555958f6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.242076] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.242076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.242076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.242076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.242076] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.242076] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be updated. [ 1369.292144] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.292144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.292144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.292144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.292144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.292652] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.292900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.293077] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.293407] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.293817] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.294046] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be created. [ 1369.306431] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1369.329457] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.329921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.330116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.331882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.331882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.349837] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: UNINITIALIZED for 2s [ 1369.394131] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.394131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.394131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.394131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.394131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.394131] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 63cbd196-515c-4f22-af11-612a555958f6 not found, creating... [ 1369.394131] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.394131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.394131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.394131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.394131] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.394714] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.394714] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.395022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.395374] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.395665] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.396056] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 63cbd196-515c-4f22-af11-612a555958f6 is going to be created. [ 1369.428594] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.429175] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.429447] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.429844] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.430233] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.430733] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-63cbd196-515c-4f22-af11-612a555958f6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.101342] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-9e32b3b3-a75a-497e-a89e-6daa57e3023e service nova] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_rules [ 1370.103122] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-9e32b3b3-a75a-497e-a89e-6daa57e3023e service nova] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1370.103122] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-9e32b3b3-a75a-497e-a89e-6daa57e3023e service nova] Enqueued Resource ID: 63cbd196-515c-4f22-af11-612a555958f6 with Priority: HIGHEST for action port [ 1370.103982] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_rules [ 1370.105695] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1370.105695] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cbd196-515c-4f22-af11-612a555958f6 with Priority: HIGHEST for action port [ 1370.105695] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.105695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.105695] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.105695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.105695] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-63cbd196-515c-4f22-af11-612a555958f6 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.105695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63cbd196-515c-4f22-af11-612a555958f6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.105695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63cbd196-515c-4f22-af11-612a555958f6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.105695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63cbd196-515c-4f22-af11-612a555958f6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.105695] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63cbd196-515c-4f22-af11-612a555958f6',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.611123] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63cbd196-515c-4f22-af11-612a555958f6 with status ACTIVE [ 1370.611123] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.611123] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.611123] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.611123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.611123] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63cbd196-515c-4f22-af11-612a555958f6 is going to be updated. [ 1370.636184] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.636184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.636184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.636184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.636184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.636184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63cbd196-515c-4f22-af11-612a555958f6" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.654830] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: SUCCESS [ 1370.654830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.317270] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1371.317557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.360217] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1371.360363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.360548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.360731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.360965] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.361125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.361125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.361354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.361354] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.361450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.361515] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.362395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.362563] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.362719] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.362823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.362880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.363030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.363149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.363235] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.664854] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-52c40e28-699b-41a5-a087-dfcc3a428279 tempest-ListServersNegativeTestJSON-401732282 tempest-ListServersNegativeTestJSON-401732282-project-member] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1371.665520] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1371.665827] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.666010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.865746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.865746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.866122] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.087482] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.087858] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.088125] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.088551] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.088993] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.089305] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.089527] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.089906] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.090183] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.090526] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1372.090746] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1372.091073] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1372.091236] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1372.091408] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1372.091570] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1372.091724] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1372.115519] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1372.115519] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1372.115519] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1372.115519] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-902" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.115929] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-632bef17-33fa-4cd9-8460-f242f7a787c8 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.116068] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-632bef17-33fa-4cd9-8460-f242f7a787c8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.116105] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-632bef17-33fa-4cd9-8460-f242f7a787c8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.117241] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-632bef17-33fa-4cd9-8460-f242f7a787c8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.117241] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632bef17-33fa-4cd9-8460-f242f7a787c8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.368331] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.619566] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.619819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.619916] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.620247] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.620397] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.620558] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 632bef17-33fa-4cd9-8460-f242f7a787c8 not found, creating... [ 1372.620824] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.620981] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.621170] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.621427] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.621570] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.621921] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.622034] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.622150] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.622366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.622499] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.622642] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 632bef17-33fa-4cd9-8460-f242f7a787c8 is going to be created. [ 1372.643708] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.646022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.646022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.646022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.646022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.646022] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-632bef17-33fa-4cd9-8460-f242f7a787c8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.872372] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.872578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.872625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.872851] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.872942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.873059] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be updated. [ 1372.907071] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.907247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.907295] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.907512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.907662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.918152] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1373.398511] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-d4a1b0a5-14d1-4d02-80c8-3d5cf0d534bc service nova] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_rules [ 1373.398511] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-d4a1b0a5-14d1-4d02-80c8-3d5cf0d534bc service nova] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1373.398511] env[69756]: INFO networking_nsxv3.common.synchronization [req-3add04f4-a96e-472d-bbf6-b4efdd62c23a req-d4a1b0a5-14d1-4d02-80c8-3d5cf0d534bc service nova] Enqueued Resource ID: 632bef17-33fa-4cd9-8460-f242f7a787c8 with Priority: HIGHEST for action port [ 1373.398511] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_rules [ 1373.398511] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1373.398511] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 632bef17-33fa-4cd9-8460-f242f7a787c8 with Priority: HIGHEST for action port [ 1373.398511] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.398511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.398511] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.398511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.399545] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-632bef17-33fa-4cd9-8460-f242f7a787c8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.399674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-632bef17-33fa-4cd9-8460-f242f7a787c8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.399734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-632bef17-33fa-4cd9-8460-f242f7a787c8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.399946] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-632bef17-33fa-4cd9-8460-f242f7a787c8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.400038] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632bef17-33fa-4cd9-8460-f242f7a787c8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.903085] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 632bef17-33fa-4cd9-8460-f242f7a787c8 with status ACTIVE [ 1373.903085] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.903085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.903085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.903085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.903085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.903085] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.903952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.903952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.903952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.903952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.903952] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.903952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.904317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.904317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.904317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.904317] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 632bef17-33fa-4cd9-8460-f242f7a787c8 is going to be updated. [ 1373.931663] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.931911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.931911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.932136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.932318] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.932498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-632bef17-33fa-4cd9-8460-f242f7a787c8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.929969] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1374.930395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.930395] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.930604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.930788] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.930906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.930986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.931151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.931258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.931359] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.433563] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.436899] env[69756]: INFO networking_nsxv3.common.synchronization [req-fce76648-15f8-470a-aa75-d1dfa60ce42e req-39dd056e-dcfc-45c1-9832-d2082f166619 tempest-ListServerFiltersTestJSON-164164359 tempest-ListServerFiltersTestJSON-164164359-project-member] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1375.437532] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1375.437838] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.437962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.438043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.438248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.438408] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.438508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.438570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.438755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.438875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.438980] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.938601] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.944283] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.443390] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.443689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.443796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.444138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.444309] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.444462] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be updated. [ 1376.445977] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.478100] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.478301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.478301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.478871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.478871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.488955] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1376.948528] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.948831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.948831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.949012] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.949110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.949214] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be updated. [ 1376.981984] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.982223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.982310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.982579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.982794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.992970] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1378.498903] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1378.499280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.499360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.499575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.499771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.499891] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.499961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.500131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.500419] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.500419] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.002033] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.003820] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1379.004080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.505112] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.009760] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.009976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.010085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.010350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.010484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.010633] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be updated. [ 1380.046042] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.046042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.046261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.046388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.046667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.056293] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1380.315497] env[69756]: INFO networking_nsxv3.common.synchronization [req-b90681fc-1b78-47b5-9b4a-805a0d0fa9a1 req-a5cb3d63-f61b-4f67-925c-ed7d0edd9dc6 tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1380.315497] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1380.315765] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.315884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.315951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.316173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.316326] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.316417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.316499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.316697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.316786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.317164] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.822266] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.822266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.822266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.822266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.822266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.822266] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.822266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.822266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.822266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.822266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.822266] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1380.851541] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.851541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.851541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.851541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.851541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.858864] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1380.933586] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.933586] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.933586] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.933586] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.934321] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.934549] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.934716] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.935753] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.935753] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.935753] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1380.935753] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1380.935753] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1380.935753] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1380.936083] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1380.936167] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1380.936328] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1380.955183] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1380.955357] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1380.955951] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1380.955951] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.956147] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.956235] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.956283] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.956629] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.956773] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.460676] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.460974] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.461164] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.461545] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.462124] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.462124] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692 not found, creating... [ 1381.462315] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.462488] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.462614] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.462870] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.463026] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.463379] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.463583] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.463769] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.464042] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.464246] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.464440] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692 is going to be created. [ 1381.485387] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.485618] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.485750] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.486045] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.486286] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.486523] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.066437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1382.066796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.067304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.067597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.067801] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.067922] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.069858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.069858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.069858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.069858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.069858] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.069858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.069858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.069858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.069858] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.074026] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.074026] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.074026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.074026] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.232266] env[69756]: INFO networking_nsxv3.common.synchronization [req-b90681fc-1b78-47b5-9b4a-805a0d0fa9a1 req-20e8b667-18ad-4425-9a7a-8fda5afad902 service nova] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 1382.232266] env[69756]: INFO networking_nsxv3.common.synchronization [req-b90681fc-1b78-47b5-9b4a-805a0d0fa9a1 req-20e8b667-18ad-4425-9a7a-8fda5afad902 service nova] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1382.232266] env[69756]: INFO networking_nsxv3.common.synchronization [req-b90681fc-1b78-47b5-9b4a-805a0d0fa9a1 req-20e8b667-18ad-4425-9a7a-8fda5afad902 service nova] Enqueued Resource ID: f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692 with Priority: HIGHEST for action port [ 1382.232266] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 1382.232266] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1382.232266] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692 with Priority: HIGHEST for action port [ 1382.232266] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.232266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.232266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.233316] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.233406] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.234254] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.234363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.234549] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.234645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.234704] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.234883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.234949] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.576761] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7b68992-7c14-4d82-b5fc-e4bf2d183177: rpc.has_security_group_logging(os_id): False [ 1382.578169] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.596356] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.596463] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.596663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.596850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.596985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.597281] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.597433] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.597529] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.597769] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.597913] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.598233] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.598376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.598472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.598668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.598797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.599438] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.599438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.599438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.599438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.599647] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.599647] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be created. [ 1382.663675] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.663826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.663881] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.664128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.664315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.675094] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1382.737454] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.737695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.737984] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692 with status ACTIVE [ 1382.738290] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.738351] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.738385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.738590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.738679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.738849] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.738954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.739044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.739225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.739311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.739503] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.739642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.739729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.739940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.740093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.740218] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692 is going to be updated. [ 1382.768062] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.768333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.768333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.768484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.768589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.768757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8f4a5dd-ea5c-4c1a-a6b7-1a7e6cb54692" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.868683] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1382.868874] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc deletion is rescheduled due to dependency. [ 1382.868987] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.869169] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.869382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.869563] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.869681] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.869746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.869899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.869981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.870089] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.080764] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.371947] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.583500] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.583731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.583801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.584073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.584190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.584312] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be updated. [ 1383.622110] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.622206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.622373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.622437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.622588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.639164] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1383.873457] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.363392] env[69756]: INFO networking_nsxv3.common.synchronization [req-a1c1b415-7a23-425f-9ad8-d2cce08170b6 req-16cbbe5f-a872-43bc-a62a-e76c43b24db8 tempest-ListServerFiltersTestJSON-164164359 tempest-ListServerFiltersTestJSON-164164359-project-member] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1384.363865] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGHEST for action security_group_members [ 1384.363911] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.364073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.364157] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.364384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.364620] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.364620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.364722] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.364918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.364970] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.365044] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.376714] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.376714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.376714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.376931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.376931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.377030] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1384.426456] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.426711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.426711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.426979] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.427176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.437608] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1384.687503] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1384.687790] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.687974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.688196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.688288] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.871264] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.871264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.871264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.871264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.871264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.871264] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.871264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.871264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.871264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.871264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.871264] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be updated. [ 1384.901289] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.901484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.901531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.901810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.901912] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.912788] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: IN_PROGRESS for 2s [ 1385.190252] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.190431] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.371609] env[69756]: INFO networking_nsxv3.common.synchronization [req-ec96b8a1-c692-4b6f-8225-9726c619d277 req-e84078cb-324d-4b36-bfb6-7eb776aa1928 tempest-ListServersNegativeTestJSON-401732282 tempest-ListServersNegativeTestJSON-401732282-project-member] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1385.372216] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1385.372580] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.372688] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.649586] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1385.649771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.649904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.650156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.650353] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.650474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.650557] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.650757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.650842] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.650933] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.651045] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.652092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.652177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.652285] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.652417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.652494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.652645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.652725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.652822] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.155023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.155145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.155342] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.449298] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1386.449689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.449739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.449939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.450151] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.450271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.450340] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.450499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.450582] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.450669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.450763] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.658274] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.893063] env[69756]: INFO networking_nsxv3.common.synchronization [req-4fa3e999-45af-4ea7-a93b-b298034216f9 req-8b77303c-222e-408e-8e34-53d9ca1cfc53 tempest-AttachVolumeNegativeTest-722480044 tempest-AttachVolumeNegativeTest-722480044-project-member] Enqueued Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_members [ 1386.893063] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGHEST for action security_group_members [ 1386.893063] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-467656a2-9495-4232-a9a3-281d06de34c1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.893063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.893256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.893439] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.893896] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.893896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.893896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.894147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.895054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.895054] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.928229] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea02386-d4f9-4c6c-b8e7-e18723540260 in Status: SUCCESS [ 1386.928447] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 deletion is rescheduled due to dependency. [ 1386.928531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.953721] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.160929] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.161110] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.161192] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.161403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.161498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.161600] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be updated. [ 1387.193268] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.193520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.193672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.193808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.194100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.204044] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1387.397401] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.397592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.397648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.397846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.397939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.398151] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.398253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.398316] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.398470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.398547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.398634] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 467656a2-9495-4232-a9a3-281d06de34c1 is going to be updated. [ 1387.428166] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.428364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.428411] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.428639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.428789] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.437381] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 467656a2-9495-4232-a9a3-281d06de34c1 in Status: IN_PROGRESS for 2s [ 1387.456124] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc: rpc.has_security_group_logging(os_id): False [ 1387.475929] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.476144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.476144] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.476361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.476453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.476699] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.476804] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.476870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.477038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.477117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.477205] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1387.552367] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.552568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.552568] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.552774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.552921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.568203] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1389.018181] env[69756]: INFO networking_nsxv3.common.synchronization [req-42dfe8e8-40f7-4f17-9612-9741e4b72792 req-1ac84912-97b4-476f-83af-6e10f2183a00 tempest-ServerActionsTestOtherA-181965576 tempest-ServerActionsTestOtherA-181965576-project-member] Enqueued Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 1389.018702] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b with Priority: HIGHEST for action security_group_members [ 1389.019020] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d49c48-1e8f-4b77-9b74-b8d508a2115b taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.019333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.019409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.019618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.019822] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.019950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.020034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.020197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.020289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.020406] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91d49c48-1e8f-4b77-9b74-b8d508a2115b',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.216310] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1389.216567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.216718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.216959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.217178] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.217300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.217364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.217524] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.217607] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.217696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.217852] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.217949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.218019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.218167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.218307] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.218400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.218459] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.218600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.218786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.218786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.218899] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.448078] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 467656a2-9495-4232-a9a3-281d06de34c1 in Status: SUCCESS [ 1389.448451] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 467656a2-9495-4232-a9a3-281d06de34c1 deletion is rescheduled due to dependency. [ 1389.448600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.523135] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.523135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.523135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.523376] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.523498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.523872] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.524069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.524187] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.524480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.524621] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.524772] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b is going to be updated. [ 1389.557751] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.557966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.557966] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.558203] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.558349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.571175] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: IN_PROGRESS for 2s [ 1389.583044] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1389.583398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.720999] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7b68992-7c14-4d82-b5fc-e4bf2d183177: rpc.has_security_group_logging(os_id): False [ 1389.738887] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.739062] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.739130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.739332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.739490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.739706] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.739810] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.739866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.740051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.740133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.740325] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.740471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.740608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.740658] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.740726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.740967] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.741131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.741197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.741429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.741498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.741546] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be updated. [ 1389.804981] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.805174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.805174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.805408] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.805558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.818470] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1390.653024] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.653024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.653024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.653024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.653024] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.653024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.653024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.653024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.653024] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.653024] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.653024] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1390.653024] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1390.653966] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1390.653966] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.653966] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1390.653966] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1390.672414] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1390.673027] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1390.673027] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1390.673027] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.673272] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-5f04eb8e-010b-4598-8810-4e9786a6ac73 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.673534] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.673664] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.674535] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.674535] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f04eb8e-010b-4598-8810-4e9786a6ac73',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.868524] env[69756]: INFO networking_nsxv3.common.synchronization [req-778ad42e-ba00-48e2-b754-bcb968699616 req-6f9ec4be-6540-4efd-9464-e05d0237ce27 tempest-ServerRescueNegativeTestJSON-1656302266 tempest-ServerRescueNegativeTestJSON-1656302266-project-member] Enqueued Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_members [ 1390.869057] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGHEST for action security_group_members [ 1390.869679] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4298b7-402f-4c7e-8e08-a2f071b6d810 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.869679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.869679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.870019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.870019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.870019] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.870537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.870537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.870537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.870537] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.176267] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.176494] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.176630] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.176925] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.177102] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.177399] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.177573] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.177688] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.177933] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.178091] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.178381] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.178591] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.178725] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.178944] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.179100] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.179250] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 5f04eb8e-010b-4598-8810-4e9786a6ac73 is going to be updated. [ 1391.202768] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.202975] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.203117] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.203476] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.203694] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.203922] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.376454] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.376620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.376696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.376925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.377029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.377220] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.377321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.377401] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.377574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.377656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.377741] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 is going to be updated. [ 1391.407930] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.408101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.408177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.408379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.408527] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.417983] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 in Status: IN_PROGRESS for 2s [ 1391.581168] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b in Status: SUCCESS [ 1391.581369] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d49c48-1e8f-4b77-9b74-b8d508a2115b deletion is rescheduled due to dependency. [ 1391.581566] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d49c48-1e8f-4b77-9b74-b8d508a2115b" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.833133] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1391.833133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.833133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.833133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.833133] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.903299] env[69756]: INFO networking_nsxv3.common.synchronization [req-eee1f7ca-2bd9-4d2b-abb0-de1f45506827 req-05266acf-462b-402c-81cf-bcfe2e632b85 service nova] Enqueued Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_rules [ 1391.903299] env[69756]: INFO networking_nsxv3.common.synchronization [req-eee1f7ca-2bd9-4d2b-abb0-de1f45506827 req-05266acf-462b-402c-81cf-bcfe2e632b85 service nova] Enqueued Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_members [ 1391.903299] env[69756]: INFO networking_nsxv3.common.synchronization [req-eee1f7ca-2bd9-4d2b-abb0-de1f45506827 req-05266acf-462b-402c-81cf-bcfe2e632b85 service nova] Enqueued Resource ID: 5f04eb8e-010b-4598-8810-4e9786a6ac73 with Priority: HIGHEST for action port [ 1391.904156] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_rules [ 1391.904449] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_members [ 1391.904691] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f04eb8e-010b-4598-8810-4e9786a6ac73 with Priority: HIGHEST for action port [ 1391.905211] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.905482] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.906220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.906389] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.906481] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.907356] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.907464] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.907506] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.907825] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.907896] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.907949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.907983] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.908148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.908234] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.908327] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.910143] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f04eb8e-010b-4598-8810-4e9786a6ac73 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.910143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.910143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.910143] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.910143] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f04eb8e-010b-4598-8810-4e9786a6ac73',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.335898] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.336130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.336130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.336361] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.336529] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.336628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.336694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.336843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.336932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.337034] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.337126] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.411096] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.411348] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.411428] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.412439] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f04eb8e-010b-4598-8810-4e9786a6ac73 with status ACTIVE [ 1392.412648] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.412764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.412883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.413132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.413222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.413521] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.413663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.413734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.413907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.413992] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.414202] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.414300] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.414720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.414720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.414815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.414851] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f04eb8e-010b-4598-8810-4e9786a6ac73 is going to be updated. [ 1392.435643] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.435861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.435861] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.436086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.436224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.436390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f04eb8e-010b-4598-8810-4e9786a6ac73" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.839771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.840136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.840136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.840326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.840371] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.840479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.840542] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.840686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.840779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.840863] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.842033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.842033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.842033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.842033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.842033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.842033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.842033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.842033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.842033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.842033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.842033] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.917328] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.345069] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7b68992-7c14-4d82-b5fc-e4bf2d183177: rpc.has_security_group_logging(os_id): False [ 1393.362262] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.362440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.362488] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.362711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.362808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.363020] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.363135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.363177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.363323] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.363441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.363636] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.363732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.363793] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.363931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.364013] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.364208] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.364301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.364358] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.364497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.364571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.364650] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be updated. [ 1393.420394] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.420539] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.420707] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.420813] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.420902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.420997] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c14839ba-8bdf-4b61-a062-7509aa291e61 is going to be updated. [ 1393.422781] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.422893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.422963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.423147] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.423285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.436246] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 in Status: SUCCESS [ 1393.436422] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 deletion is rescheduled due to dependency. [ 1393.436516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.441107] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1393.515594] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.515878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.515878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.516153] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.516301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.527067] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: IN_PROGRESS for 2s [ 1395.459422] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1395.459648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.537641] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: SUCCESS [ 1395.537903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.538053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.538296] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.538551] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.538686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.538775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.538931] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.539024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.539124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.539217] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.041815] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.544685] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c14839ba-8bdf-4b61-a062-7509aa291e61: rpc.has_security_group_logging(os_id): False [ 1396.565527] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.565726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.565726] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.565984] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.566109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.567070] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.567070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.567070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.567070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.567070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.567070] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c14839ba-8bdf-4b61-a062-7509aa291e61 is going to be updated. [ 1396.630551] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.630752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.630752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.630919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.631083] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.646472] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: IN_PROGRESS for 2s [ 1396.906195] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.906390] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1397.572678] env[69756]: INFO networking_nsxv3.common.synchronization [req-6fb5c7c7-3709-4746-bc0e-a87b223a3353 req-af38e0e2-ce60-4bf2-83b7-75e8ec6714d7 tempest-ListServersNegativeTestJSON-401732282 tempest-ListServersNegativeTestJSON-401732282-project-member] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1397.573254] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1397.573643] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.573734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.573819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.574098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.574191] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.574324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.574324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.574519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.574591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.574711] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.644628] env[69756]: INFO networking_nsxv3.common.synchronization [req-8035b118-5b06-454e-b6bd-bef803b41c7f req-8f0bad3d-cacc-43e9-8ec3-535cf0203786 tempest-ListServersNegativeTestJSON-401732282 tempest-ListServersNegativeTestJSON-401732282-project-member] Enqueued Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1397.645184] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 with Priority: HIGHEST for action security_group_members [ 1397.645494] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b68992-7c14-4d82-b5fc-e4bf2d183177 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.645608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.078452] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.580952] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.661728] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: SUCCESS [ 1398.661932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.083633] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.083844] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.083894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.084194] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.084346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.084510] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be updated. [ 1399.112318] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.112480] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.112942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.112942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.112942] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.122724] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1401.134365] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1401.134692] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.134808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.135056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.135245] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.135360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.135427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.135588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.135668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.135764] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b68992-7c14-4d82-b5fc-e4bf2d183177',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.638023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.638265] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.638350] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.638576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.638670] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.638877] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.638978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.639063] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.639217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.639297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.639442] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 is going to be updated. [ 1401.670276] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.670574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.670574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.670705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.670860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.684773] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: IN_PROGRESS for 2s [ 1402.329187] env[69756]: INFO networking_nsxv3.common.synchronization [None req-9c4f1d9b-baa5-45cd-b97a-a7be7220e9a0 None None] Enqueued Resource ID: 4785e6c0-8211-48c0-8730-7399cb2ad674 with Priority: HIGHEST for action port [ 1402.329914] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4785e6c0-8211-48c0-8730-7399cb2ad674 with Priority: HIGHEST for action port [ 1402.330752] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-4785e6c0-8211-48c0-8730-7399cb2ad674 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.331285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4785e6c0-8211-48c0-8730-7399cb2ad674" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.332036] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4785e6c0-8211-48c0-8730-7399cb2ad674" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.332314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4785e6c0-8211-48c0-8730-7399cb2ad674" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.332392] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4785e6c0-8211-48c0-8730-7399cb2ad674',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.835420] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4785e6c0-8211-48c0-8730-7399cb2ad674 [ 1402.835708] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.835866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.836128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.836457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.836604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.836754] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4785e6c0-8211-48c0-8730-7399cb2ad674 already deleted. [ 1402.836888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4785e6c0-8211-48c0-8730-7399cb2ad674" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.699161] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 in Status: SUCCESS [ 1403.699468] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b68992-7c14-4d82-b5fc-e4bf2d183177 deletion is rescheduled due to dependency. [ 1403.699509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b68992-7c14-4d82-b5fc-e4bf2d183177" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.822239] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e281f44d-f1ba-4773-8db7-d240f29b6a07 None None] Enqueued Resource ID: 0d05bf37-5bf2-4371-a457-de73022daa33 with Priority: HIGHEST for action port [ 1404.822530] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d05bf37-5bf2-4371-a457-de73022daa33 with Priority: HIGHEST for action port [ 1404.823075] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d05bf37-5bf2-4371-a457-de73022daa33 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.823205] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d05bf37-5bf2-4371-a457-de73022daa33" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.823626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d05bf37-5bf2-4371-a457-de73022daa33" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.823626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d05bf37-5bf2-4371-a457-de73022daa33" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.823626] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d05bf37-5bf2-4371-a457-de73022daa33',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.325400] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d05bf37-5bf2-4371-a457-de73022daa33 [ 1405.325653] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.325842] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.325939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.326127] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.326220] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.326319] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d05bf37-5bf2-4371-a457-de73022daa33 already deleted. [ 1405.326397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d05bf37-5bf2-4371-a457-de73022daa33" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.709110] env[69756]: INFO networking_nsxv3.common.synchronization [req-9c2cc5e2-4494-4938-865d-2256d9bd975a req-25ba85d9-6c4f-46f5-a876-37be92bdfe45 tempest-ServerRescueNegativeTestJSON-1656302266 tempest-ServerRescueNegativeTestJSON-1656302266-project-member] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1405.709611] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1405.709916] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.710045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.710113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.710321] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.710493] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.710597] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.710660] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.710815] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.710903] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.710995] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.213441] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.716090] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.218844] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.219174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.219174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.219293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.219384] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.219489] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f is going to be updated. [ 1407.255511] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.255661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.255733] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.256080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.256241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.268296] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: IN_PROGRESS for 2s [ 1407.733720] env[69756]: INFO networking_nsxv3.common.synchronization [req-d17fd81c-b276-4294-887b-e98e0e94eaa7 req-947e90b8-9bf9-4a8f-a2ab-0ddf66ac896c tempest-ServerMetadataTestJSON-1661149669 tempest-ServerMetadataTestJSON-1661149669-project-member] Enqueued Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGHEST for action security_group_members [ 1407.734256] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGHEST for action security_group_members [ 1407.737202] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-316293a2-8f3c-4abb-ae9d-8a7732ef7858 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.737202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.737202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.737202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.737202] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.737202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.737202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.737202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.737202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.737202] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316293a2-8f3c-4abb-ae9d-8a7732ef7858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.998956] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.999295] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.999490] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.999775] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.000256] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.000506] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.000610] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.000843] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.001011] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.001275] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1408.001430] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1408.001565] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1408.001693] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1408.001793] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1408.001915] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1408.002053] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1408.022144] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1408.022307] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1408.022455] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1408.022639] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-153" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.022987] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-b61f2449-20d3-4a43-9c17-67c2da8162dc taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.023197] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-b61f2449-20d3-4a43-9c17-67c2da8162dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.023320] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-b61f2449-20d3-4a43-9c17-67c2da8162dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.023688] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-b61f2449-20d3-4a43-9c17-67c2da8162dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.023837] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b61f2449-20d3-4a43-9c17-67c2da8162dc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.238326] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.238694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.238694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.238799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.238838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.239023] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.239123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.239188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.239337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.239418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.239499] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 already deleted. [ 1408.239578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.526244] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.526585] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.526659] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.526941] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.527112] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.527276] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port b61f2449-20d3-4a43-9c17-67c2da8162dc not found, creating... [ 1408.527557] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.527723] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.527900] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.528104] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.528321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.528510] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.528673] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.528794] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.529021] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.529168] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.529315] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: b61f2449-20d3-4a43-9c17-67c2da8162dc is going to be created. [ 1408.565184] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.565433] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.565523] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.565819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.566080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.566321] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-b61f2449-20d3-4a43-9c17-67c2da8162dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.251012] env[69756]: INFO networking_nsxv3.common.synchronization [req-d17fd81c-b276-4294-887b-e98e0e94eaa7 req-55292a36-8c5a-457a-b714-3b3bf0252c45 service nova] Enqueued Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGHEST for action security_group_rules [ 1409.251299] env[69756]: INFO networking_nsxv3.common.synchronization [req-d17fd81c-b276-4294-887b-e98e0e94eaa7 req-55292a36-8c5a-457a-b714-3b3bf0252c45 service nova] Enqueued Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGHEST for action security_group_members [ 1409.251359] env[69756]: INFO networking_nsxv3.common.synchronization [req-d17fd81c-b276-4294-887b-e98e0e94eaa7 req-55292a36-8c5a-457a-b714-3b3bf0252c45 service nova] Enqueued Resource ID: b61f2449-20d3-4a43-9c17-67c2da8162dc with Priority: HIGHEST for action port [ 1409.252029] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGHEST for action security_group_rules [ 1409.252029] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGHEST for action security_group_members [ 1409.252029] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61f2449-20d3-4a43-9c17-67c2da8162dc with Priority: HIGHEST for action port [ 1409.252457] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.252626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.252657] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.252894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.252977] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316293a2-8f3c-4abb-ae9d-8a7732ef7858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.254869] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-316293a2-8f3c-4abb-ae9d-8a7732ef7858 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.255015] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.255119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.255328] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.255861] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.256051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.256212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.256410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.256537] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.256666] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316293a2-8f3c-4abb-ae9d-8a7732ef7858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.257561] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-b61f2449-20d3-4a43-9c17-67c2da8162dc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.257663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b61f2449-20d3-4a43-9c17-67c2da8162dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.257755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b61f2449-20d3-4a43-9c17-67c2da8162dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.257940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b61f2449-20d3-4a43-9c17-67c2da8162dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.258059] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b61f2449-20d3-4a43-9c17-67c2da8162dc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.280048] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: SUCCESS [ 1409.280048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.759484] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-316293a2-8f3c-4abb-ae9d-8a7732ef7858 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.759630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.760998] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b61f2449-20d3-4a43-9c17-67c2da8162dc with status ACTIVE [ 1409.761195] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.761317] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.761385] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.761612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.761702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.761867] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.761960] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.762028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.762181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.762262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.762440] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.762535] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.762592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.762732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.762807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.762890] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b61f2449-20d3-4a43-9c17-67c2da8162dc is going to be updated. [ 1409.764007] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('316293a2-8f3c-4abb-ae9d-8a7732ef7858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.785411] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.785684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.785684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.785860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.786029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.786194] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b61f2449-20d3-4a43-9c17-67c2da8162dc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.268106] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('316293a2-8f3c-4abb-ae9d-8a7732ef7858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.770506] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.770721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.770766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.770957] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.771070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.771232] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 is going to be created. [ 1410.796310] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.796522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.796522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.796736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.796899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.805962] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 in Status: UNINITIALIZED for 2s [ 1412.290320] env[69756]: INFO networking_nsxv3.common.synchronization [req-e5568f80-7d74-45a8-b36b-d9141233fa26 req-ecd47d79-3789-4ac9-b069-b384fed41a46 tempest-ServerRescueNegativeTestJSON-1656302266 tempest-ServerRescueNegativeTestJSON-1656302266-project-member] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1412.291060] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGHEST for action security_group_members [ 1412.291160] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.291258] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.291331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.291551] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.292104] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.292226] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.292299] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.292458] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.292548] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.292644] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.794657] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.794919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.794919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.795161] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.795310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.795517] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.795626] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.795689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.795855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.795948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.796050] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f is going to be updated. [ 1412.816585] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 in Status: SUCCESS [ 1412.816791] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.816939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.817177] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.817361] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.817475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.817538] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.817682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.817765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.817848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.817937] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('316293a2-8f3c-4abb-ae9d-8a7732ef7858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.828244] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.828428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.828479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.828636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.828773] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.839411] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: IN_PROGRESS for 2s [ 1413.319684] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-316293a2-8f3c-4abb-ae9d-8a7732ef7858 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.319971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.319971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.320206] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.320381] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.320483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.320547] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.320702] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.320850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.320989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.321159] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-316293a2-8f3c-4abb-ae9d-8a7732ef7858 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.321285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.321285] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.321441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.321565] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.321675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.321746] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.321934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.322033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.322099] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.322226] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('316293a2-8f3c-4abb-ae9d-8a7732ef7858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.824693] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 316293a2-8f3c-4abb-ae9d-8a7732ef7858: rpc.has_security_group_logging(os_id): False [ 1413.845025] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.845255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.845356] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.845645] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.845796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.846034] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.846140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.846207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.846380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.846468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.846762] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.846925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.847033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.847233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.847387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.847589] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.847693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.847757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.847921] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.848030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.848158] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 is going to be created. [ 1413.926640] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.926890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.926890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.927101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.927293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.944311] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 in Status: IN_PROGRESS for 2s [ 1414.849940] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f in Status: SUCCESS [ 1414.849940] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f deletion is rescheduled due to dependency. [ 1414.849940] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.957255] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 in Status: SUCCESS [ 1415.957638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.292562] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.292562] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.894696] env[69756]: INFO networking_nsxv3.common.synchronization [req-cd73aecb-dfec-4a8e-8aa0-c63e8cc04d4c req-7cebc1b6-3386-49dc-8498-2681a4a2dd74 tempest-ServerMetadataTestJSON-1661149669 tempest-ServerMetadataTestJSON-1661149669-project-member] Enqueued Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGHEST for action security_group_members [ 1420.895237] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGHEST for action security_group_members [ 1420.895545] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-316293a2-8f3c-4abb-ae9d-8a7732ef7858 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.895664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.895764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.896448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.896448] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.896448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.896448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.896448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.896755] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.896755] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316293a2-8f3c-4abb-ae9d-8a7732ef7858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.399256] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.399479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.399589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.399911] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.400079] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.400337] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.400454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.400556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.400802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.400905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.401030] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 is going to be updated. [ 1421.432663] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.432860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.432860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.433092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.433262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.443436] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 in Status: IN_PROGRESS for 2s [ 1423.454586] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 in Status: SUCCESS [ 1423.454999] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 deletion is rescheduled due to dependency. [ 1423.454999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.896842] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.896842] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.898420] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.898794] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.899966] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.900411] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1437.497080] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1437.497080] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1440.901064] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.901418] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.902095] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.902479] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.855115] env[69756]: INFO networking_nsxv3.common.synchronization [req-3ddc4663-ea63-4c0b-b744-d09ad6a5de6d req-f7a55824-9c10-4eec-9dc6-99b8866b0d19 tempest-AttachVolumeShelveTestJSON-990643214 tempest-AttachVolumeShelveTestJSON-990643214-project-member] Enqueued Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_members [ 1450.855644] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14839ba-8bdf-4b61-a062-7509aa291e61 with Priority: HIGHEST for action security_group_members [ 1450.855950] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-c14839ba-8bdf-4b61-a062-7509aa291e61 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.856089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.856149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.856355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.856510] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.856609] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.856680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.856816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.856900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.856999] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c14839ba-8bdf-4b61-a062-7509aa291e61',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.360911] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.361158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.361158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.361370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.361470] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.361667] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.361763] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.361821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.362024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.362137] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.362137] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c14839ba-8bdf-4b61-a062-7509aa291e61 is going to be updated. [ 1451.390770] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.391021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.391021] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.391213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.391355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.401083] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: IN_PROGRESS for 2s [ 1453.411997] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c14839ba-8bdf-4b61-a062-7509aa291e61 in Status: SUCCESS [ 1453.412371] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c14839ba-8bdf-4b61-a062-7509aa291e61 deletion is rescheduled due to dependency. [ 1453.412371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c14839ba-8bdf-4b61-a062-7509aa291e61" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.581777] env[69756]: INFO networking_nsxv3.common.synchronization [None req-77ae40da-d262-46a7-9f06-fd47f27adc1a tempest-AttachVolumeShelveTestJSON-990643214 tempest-AttachVolumeShelveTestJSON-990643214-project-member] Enqueued Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_rules [ 1455.582359] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_rules [ 1455.582747] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.582899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.583009] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.583308] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.583386] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.657093] env[69756]: INFO networking_nsxv3.common.synchronization [None req-5a2d24b6-5ecd-4d46-b3dc-476c96dc58d6 tempest-AttachVolumeShelveTestJSON-990643214 tempest-AttachVolumeShelveTestJSON-990643214-project-member] Enqueued Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_rules [ 1455.657610] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_rules [ 1455.657919] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.658042] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.105855] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.106057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.106185] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.106319] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.106412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.106622] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 already deleted. [ 1456.106622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.106879] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.107056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.107142] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.627230] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.627642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.627642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.627642] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.627797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.627797] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 already deleted. [ 1456.627889] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.658635] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.659074] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.956227] env[69756]: INFO networking_nsxv3.common.synchronization [req-51a884f5-02ae-44b3-8fc9-da0bd82d6bca req-f0510bb8-99d1-484f-9854-c125c17cd994 tempest-AttachVolumeShelveTestJSON-990643214 tempest-AttachVolumeShelveTestJSON-990643214-project-member] Enqueued Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_members [ 1460.956881] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_members [ 1460.957108] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.957200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.957325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.957555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.957742] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.957855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.957915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.958070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.958149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.958244] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.226708] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.226923] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.227042] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.227333] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.227590] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.227753] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.227873] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.228105] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.228259] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.228467] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1461.228633] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1461.228768] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1461.228885] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1461.229019] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1461.229134] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1461.229274] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1461.251360] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1461.251557] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1461.251683] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1461.251836] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.252181] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-f6b88e9f-b339-4250-a7d9-3837f9a08c57 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.252357] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.252480] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.252819] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.252964] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6b88e9f-b339-4250-a7d9-3837f9a08c57',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.460446] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.460674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.460674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.460893] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.460986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.461205] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.461311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.461366] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.461528] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.461603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.461689] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 already deleted. [ 1461.461771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.631834] env[69756]: INFO networking_nsxv3.common.synchronization [req-9960150d-5b2b-4659-b2ae-ecec5d12165e req-227d865f-b030-4f47-bef0-49289d97bdf6 tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1461.632449] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1461.632804] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.632956] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.633055] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.633287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.633488] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.633632] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.633717] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.633896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.634028] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.634168] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.755647] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.756066] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.756066] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.756274] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.756432] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.756570] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port f6b88e9f-b339-4250-a7d9-3837f9a08c57 not found, creating... [ 1461.756826] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.756985] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.757121] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.757352] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.757507] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.757789] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.757948] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.758104] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.758331] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.758470] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.758612] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: f6b88e9f-b339-4250-a7d9-3837f9a08c57 is going to be created. [ 1461.778594] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.778818] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.778954] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.779290] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.779542] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.779777] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.138947] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.139212] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.139337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.139639] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.139797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.140108] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.140266] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.140391] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.140591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.140677] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.140768] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1462.171895] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.171895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.171895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.171895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.171895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.179818] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1462.447851] env[69756]: INFO networking_nsxv3.common.synchronization [req-51a884f5-02ae-44b3-8fc9-da0bd82d6bca req-16992814-aea9-41f0-9965-f6f51a56a120 service nova] Enqueued Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_rules [ 1462.448058] env[69756]: INFO networking_nsxv3.common.synchronization [req-51a884f5-02ae-44b3-8fc9-da0bd82d6bca req-16992814-aea9-41f0-9965-f6f51a56a120 service nova] Enqueued Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_members [ 1462.448209] env[69756]: INFO networking_nsxv3.common.synchronization [req-51a884f5-02ae-44b3-8fc9-da0bd82d6bca req-16992814-aea9-41f0-9965-f6f51a56a120 service nova] Enqueued Resource ID: f6b88e9f-b339-4250-a7d9-3837f9a08c57 with Priority: HIGHEST for action port [ 1462.448824] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_rules [ 1462.448824] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_members [ 1462.448824] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b88e9f-b339-4250-a7d9-3837f9a08c57 with Priority: HIGHEST for action port [ 1462.449227] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.449280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.449357] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.449554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.449638] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.450738] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.450850] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.450915] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.451095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.451388] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.451388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.451388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.451608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.451608] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.451718] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.452379] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6b88e9f-b339-4250-a7d9-3837f9a08c57 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.452509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.452638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.452697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.452752] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6b88e9f-b339-4250-a7d9-3837f9a08c57',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.954547] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.954917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.954917] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.957324] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6b88e9f-b339-4250-a7d9-3837f9a08c57 with status ACTIVE [ 1462.957429] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.957522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.957576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.957782] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.957871] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.958052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.958155] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.958215] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.958397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.958519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.958711] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.958807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.958870] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.959383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.959460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.959500] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6b88e9f-b339-4250-a7d9-3837f9a08c57 is going to be updated. [ 1462.979926] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.980142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.980142] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.980322] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.980454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.980610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.457897] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.960434] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.960770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.960770] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.960971] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.961104] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.961412] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 is going to be created. [ 1463.984449] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.984638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.984638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.984852] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.985018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.993822] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: UNINITIALIZED for 2s [ 1464.189431] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1464.189639] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc deletion is rescheduled due to dependency. [ 1464.189714] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.004348] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: SUCCESS [ 1466.004745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.004745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.004949] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.005169] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.005279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.005330] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.005495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.005579] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.005665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.005757] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.507815] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.010307] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2513e49c-880c-43a8-b362-c3427ec2f8e9: rpc.has_security_group_logging(os_id): False [ 1467.027667] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.027927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.027927] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.028091] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.028186] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.028427] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.028531] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.028590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.028750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.028827] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.028912] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 is going to be created. [ 1467.083542] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.083784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.083784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.083980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.084148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.094718] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: IN_PROGRESS for 2s [ 1467.449677] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.449858] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1468.566809] env[69756]: INFO networking_nsxv3.common.synchronization [req-84643a80-1e00-4140-9625-c1e4668b2535 req-badf0c0e-c232-4d25-bc3a-41f8a805b93c tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1468.567470] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1468.567853] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.568040] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.568140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.568388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.568587] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.568716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.568797] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.568980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.569148] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.569276] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.848172] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.848377] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.848502] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.848789] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.849106] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.849281] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.849406] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.849631] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.849778] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.849990] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1468.850119] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1468.850235] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1468.850348] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1468.850463] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1468.850634] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1468.850698] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1468.869437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1468.869627] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1468.869750] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1468.869931] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-193" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.870271] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-f52a2d80-9382-4e22-b304-f6723d1a7f7e taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.870450] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-f52a2d80-9382-4e22-b304-f6723d1a7f7e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.870576] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-f52a2d80-9382-4e22-b304-f6723d1a7f7e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.870972] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-f52a2d80-9382-4e22-b304-f6723d1a7f7e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.871887] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f52a2d80-9382-4e22-b304-f6723d1a7f7e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1469.074655] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.074878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.074934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.075578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.075578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.075578] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.075822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.075822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.075978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.076072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.076129] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1469.101092] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.101351] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.101351] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.101606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.101834] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.112703] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1469.115170] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: SUCCESS [ 1469.115412] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.373632] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.373855] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.373968] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.374317] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.374510] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.374710] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port f52a2d80-9382-4e22-b304-f6723d1a7f7e not found, creating... [ 1469.374915] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.375100] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.375244] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.375492] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.375640] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.375932] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.376107] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.376232] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.376455] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.376598] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.376742] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: f52a2d80-9382-4e22-b304-f6723d1a7f7e is going to be created. [ 1469.398842] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.399160] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.399233] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.399484] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.399720] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.399963] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-f52a2d80-9382-4e22-b304-f6723d1a7f7e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.523466] env[69756]: INFO networking_nsxv3.common.synchronization [req-84643a80-1e00-4140-9625-c1e4668b2535 req-74282ec5-41c3-46b7-be80-88b7164a6006 service nova] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 1470.523873] env[69756]: INFO networking_nsxv3.common.synchronization [req-84643a80-1e00-4140-9625-c1e4668b2535 req-74282ec5-41c3-46b7-be80-88b7164a6006 service nova] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1470.523960] env[69756]: INFO networking_nsxv3.common.synchronization [req-84643a80-1e00-4140-9625-c1e4668b2535 req-74282ec5-41c3-46b7-be80-88b7164a6006 service nova] Enqueued Resource ID: f52a2d80-9382-4e22-b304-f6723d1a7f7e with Priority: HIGHEST for action port [ 1470.524347] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_rules [ 1470.524494] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1470.524622] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f52a2d80-9382-4e22-b304-f6723d1a7f7e with Priority: HIGHEST for action port [ 1470.525223] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.525368] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.525429] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.525636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.525720] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1470.530173] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.530173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.530173] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f52a2d80-9382-4e22-b304-f6723d1a7f7e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.530173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f52a2d80-9382-4e22-b304-f6723d1a7f7e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.530173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f52a2d80-9382-4e22-b304-f6723d1a7f7e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.530173] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f52a2d80-9382-4e22-b304-f6723d1a7f7e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.530173] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f52a2d80-9382-4e22-b304-f6723d1a7f7e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1471.030551] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.030781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.030871] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f52a2d80-9382-4e22-b304-f6723d1a7f7e with status ACTIVE [ 1471.031052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.031159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.031222] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.031427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.031515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.031710] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.031874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.031874] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.032035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.032117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.032320] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.032434] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.032497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.032668] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.032750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.032837] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f52a2d80-9382-4e22-b304-f6723d1a7f7e is going to be updated. [ 1471.054029] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.054029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.054029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.054029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.054029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.054029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f52a2d80-9382-4e22-b304-f6723d1a7f7e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.131277] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1471.131609] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc deletion is rescheduled due to dependency. [ 1471.131747] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.131918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.132156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.132372] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.132502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.132561] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.132728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.132806] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.132901] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1471.635245] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.137832] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.642126] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.642126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.642126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.642126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.642126] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.642126] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1472.677205] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.677446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.677446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.677628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.677774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.687580] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1474.700962] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1474.701491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.701491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.701669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.701941] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.702169] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.702169] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.702430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.702558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.702683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.702776] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.205057] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.526159] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.526378] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1475.707268] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc: rpc.has_security_group_logging(os_id): False [ 1475.724494] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.724771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.724771] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.724939] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.725048] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.725307] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.725415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.725495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.725627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.725705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.725793] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1475.785127] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.785370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.785370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.785530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.785680] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.799638] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1477.815585] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1477.815993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.527858] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.528346] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.529224] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.529650] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.530420] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.530864] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.445587] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.445838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.445838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.446051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.446165] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.948771] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.450936] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.953904] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1492.954341] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1493.673019] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.673233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.673233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.673381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.686571] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1493.687403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.688120] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1493.725788] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.725989] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.726082] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.726225] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.739207] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.740016] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1493.740094] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1493.740189] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1493.780436] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.780715] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.780715] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.780932] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.782197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.782387] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1493.863625] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.863863] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.863863] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.864081] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.864362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.864687] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1493.950366] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.950648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.950648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.950833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.951227] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.951509] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1493.951617] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a55f513a-b24f-43aa-8d5c-60a35c3553a1', '1af15216-8a46-487f-bf50-9d818405d3fe', '316293a2-8f3c-4abb-ae9d-8a7732ef7858', '58d8feed-cd04-49d0-9fbe-c89808cf758f', '1ce25057-2acd-458d-b4eb-a7f4902ea73f', '467656a2-9495-4232-a9a3-281d06de34c1', '867f2d31-4611-4fd9-ab17-4761f9cc8675', '2513e49c-880c-43a8-b362-c3427ec2f8e9', '6eeacafc-9338-4b00-81ae-be5fbe3d68e7', '3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8', '37b1babe-a5b8-4ddc-adde-c9ed4a126102', 'b6e14423-20f6-4632-a776-83c92acbd98e', 'ba3e102e-a2e2-4e4c-8876-a8535ec52fd0', 'd8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc', '4d9269ab-57a3-474d-a98c-7ba1583e57fc', 'f601c152-eb22-420e-b5ef-b628b6976a70', '32c981c7-b7d3-4add-9b02-8a36551527e8', 'aea02386-d4f9-4c6c-b8e7-e18723540260', '9b4298b7-402f-4c7e-8e08-a2f071b6d810', '85796156-67df-4d82-b494-0ea64303f9ba', '285c5000-ac60-42b0-8441-f857f98438d0', 'fa5dd68d-835d-4416-ac9f-cab1591b2b82', 'bdf28d13-db76-40d0-a00d-750f9a74b1d7', '6c2c5148-c58a-4fc6-be42-8d4236e7fbb5', '7fd17e7b-8910-4529-a801-b80ed3d29a0e', 'b7abf7f6-a856-4157-be54-ef99b007674f', '77ecb29c-d932-487b-b95d-59676b2a2f50', '8e923000-de4f-4614-8d9f-829896824884', '73cf7e80-866c-4475-93d6-8e9e3254cf79', '35f81967-0f86-4790-a162-021bab0aad8d', '70b83947-df81-4c26-945b-c5d14986de4a', '7d711ed5-98da-4810-9f03-9148ad645008', '49317fc3-59c5-4b8b-a14b-79b0c266a17a', 'dd71eef3-fdb4-4293-8cf4-077891626874', '9e669f6b-9b7b-497e-9670-1ddbd9860754', '790cacf0-2ff7-4926-9b9d-c3a421bdf3b0', 'f76720d0-5804-46fa-8a2f-21842f720546', '8de5d68d-6838-4955-ae71-d9dd48c0a125', '91d49c48-1e8f-4b77-9b74-b8d508a2115b', 'b5f631a6-10e1-4423-9d64-92e1be795a21', '4b6578e8-a78e-4c09-82f2-a7faaacca9bc', 'c14839ba-8bdf-4b61-a062-7509aa291e61', 'a6688165-9289-4b4f-a688-1379d300b9cd', '4cae8dc5-dcca-4592-aebe-26bb46462d80', 'c7b68992-7c14-4d82-b5fc-e4bf2d183177', '3669143c-24cd-4014-976c-a88fbc9ce9be'} {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1493.951740] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1493.973794] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.974240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.974240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.974240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.974362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.974397] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1493.974471] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1493.974568] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1494.049092] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.049332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.049332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.049507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.050739] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.051014] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1494.051095] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1494.051185] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1494.051285] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1494.051379] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1494.051457] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGH for action security_group_rules [ 1494.051535] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGH for action security_group_rules [ 1494.051599] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGH for action security_group_rules [ 1494.051662] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGH for action security_group_rules [ 1494.051731] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGH for action security_group_rules [ 1494.051789] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGH for action security_group_rules [ 1494.051834] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGH for action security_group_rules [ 1494.051895] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGH for action security_group_rules [ 1494.051952] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGH for action security_group_rules [ 1494.052018] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGH for action security_group_rules [ 1494.052086] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGH for action security_group_rules [ 1494.052138] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGH for action security_group_rules [ 1494.052201] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGH for action security_group_rules [ 1494.052275] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGH for action security_group_rules [ 1494.052325] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGH for action security_group_rules [ 1494.052385] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGH for action security_group_rules [ 1494.052438] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGH for action security_group_rules [ 1494.052552] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGH for action security_group_rules [ 1494.052552] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGH for action security_group_rules [ 1494.052640] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGH for action security_group_rules [ 1494.052788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.531994] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.532395] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1495.532395] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 with Priority: HIGH for action security_group_rules [ 1495.532395] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 with Priority: HIGH for action security_group_rules [ 1495.532558] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 with Priority: HIGH for action security_group_rules [ 1495.532597] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc with Priority: HIGH for action security_group_rules [ 1495.532683] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85796156-67df-4d82-b494-0ea64303f9ba with Priority: HIGH for action security_group_rules [ 1495.533582] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 with Priority: HIGH for action security_group_rules [ 1495.533749] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea02386-d4f9-4c6c-b8e7-e18723540260 with Priority: HIGH for action security_group_rules [ 1495.533868] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 with Priority: HIGH for action security_group_rules [ 1495.533952] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGH for action security_group_rules [ 1495.534059] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601c152-eb22-420e-b5ef-b628b6976a70 with Priority: HIGH for action security_group_rules [ 1495.534156] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 with Priority: HIGH for action security_group_rules [ 1495.534246] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e14423-20f6-4632-a776-83c92acbd98e with Priority: HIGH for action security_group_rules [ 1495.534334] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 with Priority: HIGH for action security_group_rules [ 1495.534419] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 with Priority: HIGH for action security_group_rules [ 1495.534503] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 with Priority: HIGH for action security_group_rules [ 1495.534607] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 467656a2-9495-4232-a9a3-281d06de34c1 with Priority: HIGH for action security_group_rules [ 1495.534697] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGH for action security_group_rules [ 1495.534783] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f with Priority: HIGH for action security_group_rules [ 1495.534866] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af15216-8a46-487f-bf50-9d818405d3fe with Priority: HIGH for action security_group_rules [ 1495.534953] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f with Priority: HIGH for action security_group_rules [ 1495.535297] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.535426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.535487] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.535749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.535837] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a55f513a-b24f-43aa-8d5c-60a35c3553a1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.536833] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.536953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.537029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.537202] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.537274] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316293a2-8f3c-4abb-ae9d-8a7732ef7858',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.538049] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867f2d31-4611-4fd9-ab17-4761f9cc8675 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.538164] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.538231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.538387] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.538521] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867f2d31-4611-4fd9-ab17-4761f9cc8675',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.539149] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.539247] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.539315] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.539521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.539521] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d9269ab-57a3-474d-a98c-7ba1583e57fc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.540315] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85796156-67df-4d82-b494-0ea64303f9ba taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.540414] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.540476] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.540625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.540692] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85796156-67df-4d82-b494-0ea64303f9ba',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.541371] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.541448] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.541504] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.541651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.541721] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4298b7-402f-4c7e-8e08-a2f071b6d810',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.542384] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aea02386-d4f9-4c6c-b8e7-e18723540260 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.542494] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.542580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.542695] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.542766] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aea02386-d4f9-4c6c-b8e7-e18723540260',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.543430] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32c981c7-b7d3-4add-9b02-8a36551527e8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.543575] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.543628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.543734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.543802] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32c981c7-b7d3-4add-9b02-8a36551527e8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.544620] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.544775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.544775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.544904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.544976] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.545638] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f601c152-eb22-420e-b5ef-b628b6976a70 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.545788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.545788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.545945] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.546031] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f601c152-eb22-420e-b5ef-b628b6976a70',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.546693] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.546781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.546849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.546990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.547067] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba3e102e-a2e2-4e4c-8876-a8535ec52fd0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.547732] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e14423-20f6-4632-a776-83c92acbd98e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.547853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.547905] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.548024] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.548093] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e14423-20f6-4632-a776-83c92acbd98e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.550412] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.550514] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.550586] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.550721] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.551294] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b1babe-a5b8-4ddc-adde-c9ed4a126102',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.551449] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.551577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.551640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.551757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.551833] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.552470] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.552567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.552629] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.552779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.552866] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eeacafc-9338-4b00-81ae-be5fbe3d68e7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.553596] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-467656a2-9495-4232-a9a3-281d06de34c1 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.553710] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.553768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.553913] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.553984] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('467656a2-9495-4232-a9a3-281d06de34c1',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.554665] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.554830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.554830] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.554981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.555058] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.555735] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.555845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.555908] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.556069] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.556141] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce25057-2acd-458d-b4eb-a7f4902ea73f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.556787] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1af15216-8a46-487f-bf50-9d818405d3fe taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.556910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.556980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.557140] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.557233] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1af15216-8a46-487f-bf50-9d818405d3fe',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.557950] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8feed-cd04-49d0-9fbe-c89808cf758f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.558067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.558128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.558275] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.558342] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8feed-cd04-49d0-9fbe-c89808cf758f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.583017] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.583243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.583243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.583428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.584953] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.585123] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.603849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.604074] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32c981c7-b7d3-4add-9b02-8a36551527e8 is going to be deleted. [ 1495.604913] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.605146] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.622735] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.623026] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316293a2-8f3c-4abb-ae9d-8a7732ef7858 is going to be deleted. [ 1495.663882] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.664175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.664175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.664302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.664353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.664479] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32c981c7-b7d3-4add-9b02-8a36551527e8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.670098] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.670337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.670337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.670496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.670588] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.670705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316293a2-8f3c-4abb-ae9d-8a7732ef7858" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.061286] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.061441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.061508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.061691] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.061841] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.061934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.062018] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.062162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.062248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.062334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.062427] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.066644] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.066779] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.066843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.066985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.067140] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.067237] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.067298] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.067446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.067530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.067618] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.067706] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.127032] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.127273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.127273] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.127511] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.129345] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.129512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.130222] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.130374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.131067] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.131158] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.131890] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.131961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.132746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.132882] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.133571] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.133667] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.134346] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.134491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.135268] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.135367] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.136481] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.136622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.137273] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.137370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.137950] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1496.138400] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.138520] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.139284] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1496.139760] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.139877] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.140580] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1496.141052] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.141171] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.141974] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1496.142387] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.142516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.143600] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1496.143999] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.144151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.155135] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1496.155679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.155852] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aea02386-d4f9-4c6c-b8e7-e18723540260 is going to be deleted. [ 1496.156904] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.157138] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.179293] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.179518] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e14423-20f6-4632-a776-83c92acbd98e is going to be deleted. [ 1496.180310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.180532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.197303] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.197458] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8 is going to be deleted. [ 1496.198256] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.198474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.216754] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.216927] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce25057-2acd-458d-b4eb-a7f4902ea73f is going to be deleted. [ 1496.217768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.217986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.219936] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.220105] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.240566] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.240835] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.241848] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.241966] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4298b7-402f-4c7e-8e08-a2f071b6d810 is going to be deleted. [ 1496.242838] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.243054] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.266334] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.266565] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.267310] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.267432] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867f2d31-4611-4fd9-ab17-4761f9cc8675 is going to be deleted. [ 1496.268311] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.268536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.300468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.300649] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a55f513a-b24f-43aa-8d5c-60a35c3553a1 is going to be deleted. [ 1496.301525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.301742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.315120] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.315369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.376466] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.376714] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba3e102e-a2e2-4e4c-8876-a8535ec52fd0 is going to be deleted. [ 1496.377562] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.377824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.494357] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.494619] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.500700] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.500860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.525460] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.525682] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.527152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.527328] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 467656a2-9495-4232-a9a3-281d06de34c1 is going to be deleted. [ 1496.528168] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.528386] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.570331] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.571275] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.602833] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.603034] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1af15216-8a46-487f-bf50-9d818405d3fe is going to be deleted. [ 1496.603895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.604135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.642515] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.642731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.666686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.666885] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b1babe-a5b8-4ddc-adde-c9ed4a126102 is going to be deleted. [ 1496.667795] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.668043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.669448] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.669558] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.695220] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.695594] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.725254] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.725437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d9269ab-57a3-474d-a98c-7ba1583e57fc is going to be deleted. [ 1496.726307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.726536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.800334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.800534] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f601c152-eb22-420e-b5ef-b628b6976a70 is going to be deleted. [ 1496.801406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.801640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.828630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.828775] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eeacafc-9338-4b00-81ae-be5fbe3d68e7 is going to be deleted. [ 1496.829687] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.829898] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.837354] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.837525] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.848565] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.848786] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.856963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.857139] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8feed-cd04-49d0-9fbe-c89808cf758f is going to be deleted. [ 1496.857985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.858223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.904128] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.904317] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85796156-67df-4d82-b494-0ea64303f9ba is going to be deleted. [ 1496.905272] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.905497] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.905593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.905766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aea02386-d4f9-4c6c-b8e7-e18723540260" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.905982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.906132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.906217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.906331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e14423-20f6-4632-a776-83c92acbd98e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.906883] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.907029] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.907116] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.907260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3df99b5f-45af-4a9c-9ddc-c10c05c4c8b8" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.907392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.907543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.907625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.907736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce25057-2acd-458d-b4eb-a7f4902ea73f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.907860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.908009] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.908086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.908197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867f2d31-4611-4fd9-ab17-4761f9cc8675" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.908324] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.908467] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.908540] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.908654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4298b7-402f-4c7e-8e08-a2f071b6d810" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.908778] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.908917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.908990] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.909113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a55f513a-b24f-43aa-8d5c-60a35c3553a1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.909238] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.909379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.909454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.909564] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba3e102e-a2e2-4e4c-8876-a8535ec52fd0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.909683] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.909820] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.909894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.910007] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-467656a2-9495-4232-a9a3-281d06de34c1" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.910135] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.910274] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.910349] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.910455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1af15216-8a46-487f-bf50-9d818405d3fe" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.910577] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.910718] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.910792] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.910902] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d9269ab-57a3-474d-a98c-7ba1583e57fc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.911035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.911175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.911248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.911353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b1babe-a5b8-4ddc-adde-c9ed4a126102" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.943837] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.944100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.944100] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.944327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.944422] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.944569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f601c152-eb22-420e-b5ef-b628b6976a70" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.975089] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.975342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.975342] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.975515] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.975593] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.975727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eeacafc-9338-4b00-81ae-be5fbe3d68e7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.979361] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.979490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.979556] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.979752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.979837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.979953] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8feed-cd04-49d0-9fbe-c89808cf758f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.988668] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.988900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.988900] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.989059] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.989145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.989264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85796156-67df-4d82-b494-0ea64303f9ba" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.073401] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc: rpc.has_security_group_logging(os_id): False [ 1497.074675] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2513e49c-880c-43a8-b362-c3427ec2f8e9: rpc.has_security_group_logging(os_id): False [ 1497.110692] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.110934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.110934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.111170] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.112934] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.112934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.155930] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.156263] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.156454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.156454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.156656] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.156716] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.156773] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 is going to be updated. [ 1497.157860] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.158038] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.191706] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.192013] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.192152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.192199] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.192430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.192541] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.192642] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1497.224869] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.225129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.225129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.225280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.225421] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.241924] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: IN_PROGRESS for 2s [ 1497.247661] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.247823] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.247867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.248097] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.248241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.271077] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1499.255052] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: SUCCESS [ 1499.255450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.282754] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1499.282975] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.535825] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.536222] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.537108] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.537536] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.538254] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.538594] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.539685] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.540198] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.540768] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.541178] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.542156] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.542589] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.543675] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.544210] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1531.323805] env[69756]: INFO networking_nsxv3.common.synchronization [req-96581920-c3e4-413f-aa5e-33b29b0d5fb7 req-f6ad83f2-ff70-4776-96d3-e96b535eef89 tempest-ServerActionsTestJSON-673917999 tempest-ServerActionsTestJSON-673917999-project-member] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1531.324374] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGHEST for action security_group_members [ 1531.324685] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.324811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.324878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.325132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.325316] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.325417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.325502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.325661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.325784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.325920] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.828171] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.828628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.828628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.828628] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.828819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.828903] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.828996] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.829073] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.829232] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.829306] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.829391] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be updated. [ 1531.859420] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.859554] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.859624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.859836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.859978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.868173] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: IN_PROGRESS for 2s [ 1533.221422] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.221795] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.221919] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.222247] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.222601] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.222828] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.223043] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.223323] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.223536] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.223803] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1533.224345] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1533.224544] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1533.224713] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1533.224847] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1533.224964] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1533.225158] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1533.245333] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1533.245538] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1533.245724] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1533.245902] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-684" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.246315] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-f6b88e9f-b339-4250-a7d9-3837f9a08c57 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.246545] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.246728] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.247063] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.247246] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6b88e9f-b339-4250-a7d9-3837f9a08c57',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.750096] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.750096] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.750096] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.750458] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.750458] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.750667] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.750830] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.750953] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.751214] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.751360] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.751665] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.751820] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.751944] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.752177] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.752320] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.752468] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: f6b88e9f-b339-4250-a7d9-3837f9a08c57 is going to be updated. [ 1533.776973] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.777283] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.777346] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.777623] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.777824] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.778080] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.879632] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc in Status: SUCCESS [ 1533.879844] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc deletion is rescheduled due to dependency. [ 1533.879937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.453695] env[69756]: INFO networking_nsxv3.common.synchronization [req-12e28e49-0abc-4db6-8f0f-a0503db00296 req-eabb97cc-7d05-4c6a-a86a-d565c66f38e2 service nova] Enqueued Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_rules [ 1534.454018] env[69756]: INFO networking_nsxv3.common.synchronization [req-12e28e49-0abc-4db6-8f0f-a0503db00296 req-eabb97cc-7d05-4c6a-a86a-d565c66f38e2 service nova] Enqueued Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_members [ 1534.454316] env[69756]: INFO networking_nsxv3.common.synchronization [req-12e28e49-0abc-4db6-8f0f-a0503db00296 req-eabb97cc-7d05-4c6a-a86a-d565c66f38e2 service nova] Enqueued Resource ID: f6b88e9f-b339-4250-a7d9-3837f9a08c57 with Priority: HIGHEST for action port [ 1534.454970] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_rules [ 1534.455922] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_members [ 1534.456078] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b88e9f-b339-4250-a7d9-3837f9a08c57 with Priority: HIGHEST for action port [ 1534.456391] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.456516] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.456583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.456784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.456867] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.457706] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.461033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.461033] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.461033] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6b88e9f-b339-4250-a7d9-3837f9a08c57 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.461033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.461033] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6b88e9f-b339-4250-a7d9-3837f9a08c57',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.961844] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.963324] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.963475] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.963601] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6b88e9f-b339-4250-a7d9-3837f9a08c57 with status ACTIVE [ 1534.963756] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.963862] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.963928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.964151] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.964245] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.964466] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.964574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.964636] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.964788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.964868] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.965495] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.965612] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.965679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.965831] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.966056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.966178] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6b88e9f-b339-4250-a7d9-3837f9a08c57 is going to be updated. [ 1534.986942] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.987108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.987181] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.987393] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.987519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.987679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6b88e9f-b339-4250-a7d9-3837f9a08c57" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.468672] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.971488] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.971742] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.971841] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.972053] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.972200] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.972382] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 is going to be updated. [ 1536.004771] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.005111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.005111] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.005284] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.005444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.016535] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: IN_PROGRESS for 2s [ 1538.029028] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: SUCCESS [ 1538.029436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.029436] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.029613] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.029854] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.030022] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.030125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.030344] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.030450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.030595] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.030724] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.534106] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.036542] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2513e49c-880c-43a8-b362-c3427ec2f8e9: rpc.has_security_group_logging(os_id): False [ 1539.056632] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.056799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.056855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.057102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.057209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.057568] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.057664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.057703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.057866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.057947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.058087] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 is going to be updated. [ 1539.126871] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.127133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.127133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.127370] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.127591] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.144084] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: IN_PROGRESS for 2s [ 1539.264407] env[69756]: INFO networking_nsxv3.common.synchronization [None req-e1ea95d5-d125-432b-b7d5-7e8bf95f5a5f None None] Enqueued Resource ID: 9fc716a3-3211-4e29-90e4-fb79e3b60798 with Priority: HIGHEST for action port [ 1539.264999] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc716a3-3211-4e29-90e4-fb79e3b60798 with Priority: HIGHEST for action port [ 1539.265374] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fc716a3-3211-4e29-90e4-fb79e3b60798 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.265534] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fc716a3-3211-4e29-90e4-fb79e3b60798" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.265601] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fc716a3-3211-4e29-90e4-fb79e3b60798" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.265968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fc716a3-3211-4e29-90e4-fb79e3b60798" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.266112] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fc716a3-3211-4e29-90e4-fb79e3b60798',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.768495] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fc716a3-3211-4e29-90e4-fb79e3b60798 [ 1539.768734] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.768895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.768954] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.769166] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.769257] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.769353] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fc716a3-3211-4e29-90e4-fb79e3b60798 already deleted. [ 1539.769438] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fc716a3-3211-4e29-90e4-fb79e3b60798" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.900431] env[69756]: INFO networking_nsxv3.common.synchronization [None req-f17312d1-1d50-4b50-a475-b53debbda433 tempest-ServerActionsTestOtherB-1068274652 tempest-ServerActionsTestOtherB-1068274652-project-member] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1539.900929] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1539.901235] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.901432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.901432] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.901796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.901796] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.983782] env[69756]: INFO networking_nsxv3.common.synchronization [None req-fac1cf3c-1856-483c-a111-cd011f5a2b00 tempest-ServerActionsTestOtherB-1068274652 tempest-ServerActionsTestOtherB-1068274652-project-member] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1539.984357] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1539.984675] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.984785] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.424627] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.424627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.424627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.424627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.424627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.424627] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 already deleted. [ 1540.424627] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.425224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.425224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.425299] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.948671] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.948872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.948872] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.949530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.949530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.949530] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 already deleted. [ 1540.949734] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.161295] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: SUCCESS [ 1541.161498] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.672388] env[69756]: INFO networking_nsxv3.common.synchronization [None req-f8f62f4d-3122-4765-a9a6-c31219d36958 None None] Enqueued Resource ID: 0236b57a-0929-49eb-a761-8bc1ec1bd08d with Priority: HIGHEST for action port [ 1541.672638] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0236b57a-0929-49eb-a761-8bc1ec1bd08d with Priority: HIGHEST for action port [ 1541.673316] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-0236b57a-0929-49eb-a761-8bc1ec1bd08d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.673457] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0236b57a-0929-49eb-a761-8bc1ec1bd08d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.673521] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0236b57a-0929-49eb-a761-8bc1ec1bd08d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.673757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0236b57a-0929-49eb-a761-8bc1ec1bd08d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.673831] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0236b57a-0929-49eb-a761-8bc1ec1bd08d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.176432] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0236b57a-0929-49eb-a761-8bc1ec1bd08d [ 1542.176675] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.176788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.176856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.177124] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.177252] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.177319] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0236b57a-0929-49eb-a761-8bc1ec1bd08d already deleted. [ 1542.177409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0236b57a-0929-49eb-a761-8bc1ec1bd08d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.405713] env[69756]: INFO networking_nsxv3.common.synchronization [req-12d8ee04-4712-4573-877a-1f6e249b74e5 req-a34d9100-47a8-4c7b-8be2-ea32b5aa2d8b tempest-ServerActionsTestOtherB-1068274652 tempest-ServerActionsTestOtherB-1068274652-project-member] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1545.406631] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1545.407107] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.407236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.407292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.407536] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.407709] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.407805] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.407884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.408056] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.408133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.408232] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.689833] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.690071] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.690210] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.690562] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.690817] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.690977] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.691144] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.691366] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.691516] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.691726] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1545.691843] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1545.691955] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1545.692079] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1545.692194] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1545.692304] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1545.692462] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1545.713626] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1545.713826] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1545.713944] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1545.714175] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.714495] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.714671] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.714793] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.715224] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.715394] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.910821] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.911067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.911067] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.911241] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.911341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.911541] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.911634] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.911700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.911849] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.911925] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.912016] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 already deleted. [ 1545.912102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.218186] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.218534] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.218653] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.219086] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.219339] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.219592] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78 not found, creating... [ 1546.219876] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.220058] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.220186] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.220440] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.220644] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.220933] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.221109] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.221234] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.221452] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.221594] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.221763] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78 is going to be created. [ 1546.248961] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.249204] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.249335] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.249610] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.249837] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.250165] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.912130] env[69756]: INFO networking_nsxv3.common.synchronization [req-12d8ee04-4712-4573-877a-1f6e249b74e5 req-e612f12e-3238-420b-9603-d621c6144140 service nova] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1546.912432] env[69756]: INFO networking_nsxv3.common.synchronization [req-12d8ee04-4712-4573-877a-1f6e249b74e5 req-e612f12e-3238-420b-9603-d621c6144140 service nova] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1546.912520] env[69756]: INFO networking_nsxv3.common.synchronization [req-12d8ee04-4712-4573-877a-1f6e249b74e5 req-e612f12e-3238-420b-9603-d621c6144140 service nova] Enqueued Resource ID: 86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78 with Priority: HIGHEST for action port [ 1546.912777] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1546.912909] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1546.913106] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78 with Priority: HIGHEST for action port [ 1546.913545] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.913675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.913750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.913937] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.914055] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.914980] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.914980] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.915130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.915298] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.915514] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.915589] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.915697] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.915772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.915857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.915943] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.916886] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.916886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.916886] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.917145] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.917145] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.419774] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.419907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.420443] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.421365] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78 with status ACTIVE [ 1547.421564] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.421663] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.421705] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.421919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.422032] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.422185] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.422276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.422337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.422495] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.422574] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.422746] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.422894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.422894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.423035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.423156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.423245] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78 is going to be updated. [ 1547.445650] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.445865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.445865] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.446072] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.446223] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.446380] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86e6ebc7-8f7e-40b2-9b6b-bd23234ddd78" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.925739] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.428038] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.428243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.428243] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.428379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.428471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.428570] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be created. [ 1548.453982] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.454233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.454233] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.454406] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.454570] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.464075] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: UNINITIALIZED for 2s [ 1550.480891] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1550.481268] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.481502] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.481760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.481955] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.482085] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.482154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.482313] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.482396] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.482483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.482576] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.985054] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.487274] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa2899d8-52c4-48e7-80b1-761a59272093: rpc.has_security_group_logging(os_id): False [ 1551.505593] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.505801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.505801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.505998] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.506096] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.506339] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.506446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.506505] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.506662] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.506737] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.506825] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be created. [ 1551.562715] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.562962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.562962] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.563149] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.563336] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.576691] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1551.913692] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.913950] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1553.591877] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1553.592302] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1556.914420] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.914802] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.915364] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1561.915779] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.917090] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.917499] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.918873] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.918873] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.919714] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.919714] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.920260] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.920638] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.921260] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.921680] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1587.233879] env[69756]: INFO networking_nsxv3.common.synchronization [req-d78fc675-b52e-40b7-903b-4dc1065bf9b9 req-2065ec41-4269-446c-a959-2ff79f107615 tempest-AttachVolumeShelveTestJSON-990643214 tempest-AttachVolumeShelveTestJSON-990643214-project-member] Enqueued Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_members [ 1587.234601] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 with Priority: HIGHEST for action security_group_members [ 1587.235065] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-2513e49c-880c-43a8-b362-c3427ec2f8e9 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.235248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.235373] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.235661] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.235889] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.235982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.236068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.236240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.236363] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.236435] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2513e49c-880c-43a8-b362-c3427ec2f8e9',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.738533] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.738775] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.738836] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.739121] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.739260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.739476] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.739578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.739644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.739812] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.739894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.739982] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 is going to be updated. [ 1587.771250] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.771509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.771509] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.771666] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.771811] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.779949] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: IN_PROGRESS for 2s [ 1589.790517] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 in Status: SUCCESS [ 1589.790944] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2513e49c-880c-43a8-b362-c3427ec2f8e9 deletion is rescheduled due to dependency. [ 1589.790944] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2513e49c-880c-43a8-b362-c3427ec2f8e9" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.236136] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1592.236552] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1597.237821] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1597.238356] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1602.239269] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1602.239684] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1607.240398] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1607.240722] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.242450] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.242882] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1617.243744] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1617.244206] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1622.245200] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1622.245583] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1627.246595] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1627.247037] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1632.247899] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1632.247899] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1637.249573] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1637.249573] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1642.251026] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1642.251425] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1647.251811] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1647.252277] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1652.253177] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1652.253670] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1657.254654] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1657.255082] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1662.255968] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1662.256446] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1667.256988] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1667.257382] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1672.258445] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1672.258836] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1672.824494] env[69756]: INFO networking_nsxv3.common.synchronization [req-9e50c47e-846a-4b3b-96f0-e33896bb9c87 req-fa9dcc94-e669-4e50-ab7d-b91e98e6ebb7 tempest-ServerActionsTestOtherB-1068274652 tempest-ServerActionsTestOtherB-1068274652-project-member] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1672.824847] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1672.825237] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.825355] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.825416] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.825615] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.825776] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.825869] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.825994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.826102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.826188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.826276] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1673.329134] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.329134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.329134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.329638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.329638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.329638] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.329638] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.329809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.329809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.329876] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.329972] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1673.368079] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.368382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.368382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.368555] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.368652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.377874] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1675.389121] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1675.389560] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 deletion is rescheduled due to dependency. [ 1675.389560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.497621] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1677.497900] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1677.825997] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1677.826236] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1679.530926] env[69756]: INFO networking_nsxv3.common.synchronization [req-dbb10680-abae-4dde-a162-65128e06ca70 req-b89a98d9-f305-424e-9d6b-7e79c10ae4d7 tempest-ServerActionsTestOtherB-1068274652 tempest-ServerActionsTestOtherB-1068274652-project-member] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1679.531197] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1679.531324] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.531409] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1679.531474] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1679.531674] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1679.531821] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.531917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1679.531981] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1679.532264] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1679.532307] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1679.532371] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1679.818606] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.818825] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1679.818933] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1679.819228] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1679.819487] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.819649] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1679.819772] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1679.819992] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1679.820157] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1679.820373] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1679.820489] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1679.820603] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1679.820716] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1679.820829] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1679.820938] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1679.821160] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1679.841658] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1679.841858] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1679.841973] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1679.842174] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1679.842486] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-f43e6643-b4a6-4655-860c-ba4d6db16e95 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.842660] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-f43e6643-b4a6-4655-860c-ba4d6db16e95" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1679.842784] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-f43e6643-b4a6-4655-860c-ba4d6db16e95" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1679.843150] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-f43e6643-b4a6-4655-860c-ba4d6db16e95" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1679.843297] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f43e6643-b4a6-4655-860c-ba4d6db16e95',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1680.034158] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.034379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.034379] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.034560] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.034675] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.034860] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.034964] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.035033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.035262] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.035346] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.035437] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1680.061777] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.062010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.062010] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.062236] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.062383] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.073555] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1680.346097] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.346596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.346596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.346596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.346755] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.346941] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port f43e6643-b4a6-4655-860c-ba4d6db16e95 not found, creating... [ 1680.347212] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.347385] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.347514] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.347743] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.347891] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.348232] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.348405] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.348530] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.348747] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.348891] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.349061] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: f43e6643-b4a6-4655-860c-ba4d6db16e95 is going to be created. [ 1680.369530] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.369756] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.369912] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.370180] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.370424] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.370650] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-f43e6643-b4a6-4655-860c-ba4d6db16e95" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.056386] env[69756]: INFO networking_nsxv3.common.synchronization [req-dbb10680-abae-4dde-a162-65128e06ca70 req-5b085e78-7042-4c8a-b32c-85ef31fa1a86 service nova] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1681.056686] env[69756]: INFO networking_nsxv3.common.synchronization [req-dbb10680-abae-4dde-a162-65128e06ca70 req-5b085e78-7042-4c8a-b32c-85ef31fa1a86 service nova] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1681.056740] env[69756]: INFO networking_nsxv3.common.synchronization [req-dbb10680-abae-4dde-a162-65128e06ca70 req-5b085e78-7042-4c8a-b32c-85ef31fa1a86 service nova] Enqueued Resource ID: f43e6643-b4a6-4655-860c-ba4d6db16e95 with Priority: HIGHEST for action port [ 1681.056937] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1681.057127] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1681.057263] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43e6643-b4a6-4655-860c-ba4d6db16e95 with Priority: HIGHEST for action port [ 1681.057722] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.057917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.057917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.058331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.058405] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1681.059236] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.059334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.059527] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-f43e6643-b4a6-4655-860c-ba4d6db16e95 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.059664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f43e6643-b4a6-4655-860c-ba4d6db16e95" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.059664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f43e6643-b4a6-4655-860c-ba4d6db16e95" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.059858] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f43e6643-b4a6-4655-860c-ba4d6db16e95" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.059932] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f43e6643-b4a6-4655-860c-ba4d6db16e95',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1681.563859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.563859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.563859] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f43e6643-b4a6-4655-860c-ba4d6db16e95 with status ACTIVE [ 1681.563859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.563859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.563859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.563859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.563859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.563859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.563859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.563859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.563859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.563859] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.563859] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.564745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.564745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.564745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.564745] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.564745] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f43e6643-b4a6-4655-860c-ba4d6db16e95 is going to be updated. [ 1681.587115] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1681.587347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1681.587347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1681.587512] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1681.587651] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1681.587808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f43e6643-b4a6-4655-860c-ba4d6db16e95" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1682.084017] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1682.084418] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 deletion is rescheduled due to dependency. [ 1682.084418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1682.084507] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1682.084693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1682.084887] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1682.085033] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1682.085113] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1682.085279] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1682.085362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1682.085460] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1682.587961] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1683.090033] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1683.592633] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1683.592840] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1683.592888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1683.593101] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1683.593196] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1683.593302] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1683.621728] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1683.621929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1683.621929] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1683.622267] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1683.622347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1683.631172] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1685.643049] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1685.643049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.643049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.643049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.643049] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.643049] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.643665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.643665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.643665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.643665] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.643665] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.058431] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1686.058655] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1686.145652] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.647532] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa2899d8-52c4-48e7-80b1-761a59272093: rpc.has_security_group_logging(os_id): False [ 1686.670530] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.670765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.670765] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.670919] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.670986] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.671270] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.671403] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.671472] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.671622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.671703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.671786] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1686.728728] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.728999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.728999] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.729176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.729325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.741745] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1688.756519] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1688.756910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1691.059970] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1691.059970] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1696.061026] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1696.061026] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1701.062272] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1701.062650] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1706.063774] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1706.064394] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1711.065161] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1711.065598] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1716.066024] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1716.066498] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1721.066876] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1721.067282] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1726.067594] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1726.068373] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1731.069670] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1731.070128] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1731.443792] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1731.444051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1731.444051] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1731.444314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1731.444428] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1731.947172] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1732.449665] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1732.952072] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1732.952072] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1733.668592] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.669046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.669046] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.669156] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.683446] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1733.684428] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.685453] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1733.723852] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.724086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.724086] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.724339] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.738117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.739061] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1733.739194] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1733.739243] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1733.776638] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.776866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.776866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.777035] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.777760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.777952] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1733.874998] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.875246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.875246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.875392] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.875703] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.875999] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1733.956748] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.956993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.956993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.957179] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.957481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.957757] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:29. [ 1733.957847] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fa2899d8-52c4-48e7-80b1-761a59272093', 'd8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc', 'a6688165-9289-4b4f-a688-1379d300b9cd', '285c5000-ac60-42b0-8441-f857f98438d0', 'fa5dd68d-835d-4416-ac9f-cab1591b2b82', 'bdf28d13-db76-40d0-a00d-750f9a74b1d7', '6c2c5148-c58a-4fc6-be42-8d4236e7fbb5', '7fd17e7b-8910-4529-a801-b80ed3d29a0e', 'b7abf7f6-a856-4157-be54-ef99b007674f', '77ecb29c-d932-487b-b95d-59676b2a2f50', '73cf7e80-866c-4475-93d6-8e9e3254cf79', '8e923000-de4f-4614-8d9f-829896824884', '35f81967-0f86-4790-a162-021bab0aad8d', '7d711ed5-98da-4810-9f03-9148ad645008', '49317fc3-59c5-4b8b-a14b-79b0c266a17a', 'dd71eef3-fdb4-4293-8cf4-077891626874', '9e669f6b-9b7b-497e-9670-1ddbd9860754', '790cacf0-2ff7-4926-9b9d-c3a421bdf3b0', 'f76720d0-5804-46fa-8a2f-21842f720546', '8de5d68d-6838-4955-ae71-d9dd48c0a125', '91d49c48-1e8f-4b77-9b74-b8d508a2115b', 'b5f631a6-10e1-4423-9d64-92e1be795a21', '4b6578e8-a78e-4c09-82f2-a7faaacca9bc', '2513e49c-880c-43a8-b362-c3427ec2f8e9', '70b83947-df81-4c26-945b-c5d14986de4a', 'c14839ba-8bdf-4b61-a062-7509aa291e61', '4cae8dc5-dcca-4592-aebe-26bb46462d80', 'c7b68992-7c14-4d82-b5fc-e4bf2d183177', '3669143c-24cd-4014-976c-a88fbc9ce9be'} {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1733.957990] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1733.977796] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1733.978087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1733.978087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1733.978253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1733.978341] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.978456] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1733.978528] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1733.978599] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1734.056507] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1734.056725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1734.056725] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1734.056873] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1734.058093] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1734.058359] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1734.058440] env[69756]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69756) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1734.058512] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1734.058579] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1734.058659] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/29 resources of Type:Security Group Rules [ 1734.058729] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGH for action security_group_rules [ 1734.058809] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGH for action security_group_rules [ 1734.058888] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGH for action security_group_rules [ 1734.058964] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGH for action security_group_rules [ 1734.059033] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGH for action security_group_rules [ 1734.059132] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGH for action security_group_rules [ 1734.059226] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGH for action security_group_rules [ 1734.059311] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGH for action security_group_rules [ 1734.059376] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGH for action security_group_rules [ 1734.059437] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGH for action security_group_rules [ 1734.059498] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGH for action security_group_rules [ 1734.059557] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGH for action security_group_rules [ 1734.059618] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGH for action security_group_rules [ 1734.059678] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGH for action security_group_rules [ 1734.059737] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGH for action security_group_rules [ 1734.059790] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGH for action security_group_rules [ 1734.059852] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGH for action security_group_rules [ 1734.059912] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGH for action security_group_rules [ 1734.059975] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGH for action security_group_rules [ 1734.060040] env[69756]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGH for action security_group_rules [ 1734.060133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.070646] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1736.070955] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1736.070955] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGH for action security_group_rules [ 1736.071077] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6688165-9289-4b4f-a688-1379d300b9cd with Priority: HIGH for action security_group_rules [ 1736.071140] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 with Priority: HIGH for action security_group_rules [ 1736.071236] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a with Priority: HIGH for action security_group_rules [ 1736.071373] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 with Priority: HIGH for action security_group_rules [ 1736.071433] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76720d0-5804-46fa-8a2f-21842f720546 with Priority: HIGH for action security_group_rules [ 1736.071548] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 with Priority: HIGH for action security_group_rules [ 1736.071611] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 with Priority: HIGH for action security_group_rules [ 1736.071682] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d711ed5-98da-4810-9f03-9148ad645008 with Priority: HIGH for action security_group_rules [ 1736.071766] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd71eef3-fdb4-4293-8cf4-077891626874 with Priority: HIGH for action security_group_rules [ 1736.071852] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f81967-0f86-4790-a162-021bab0aad8d with Priority: HIGH for action security_group_rules [ 1736.071941] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e923000-de4f-4614-8d9f-829896824884 with Priority: HIGH for action security_group_rules [ 1736.072085] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 with Priority: HIGH for action security_group_rules [ 1736.072187] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 with Priority: HIGH for action security_group_rules [ 1736.072260] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7abf7f6-a856-4157-be54-ef99b007674f with Priority: HIGH for action security_group_rules [ 1736.072312] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 with Priority: HIGH for action security_group_rules [ 1736.072484] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e with Priority: HIGH for action security_group_rules [ 1736.072484] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 with Priority: HIGH for action security_group_rules [ 1736.072561] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc with Priority: HIGH for action security_group_rules [ 1736.072603] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285c5000-ac60-42b0-8441-f857f98438d0 with Priority: HIGH for action security_group_rules [ 1736.072967] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.073115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.073178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.073377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.073457] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.074587] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6688165-9289-4b4f-a688-1379d300b9cd taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.074587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.074764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.074764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.074850] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6688165-9289-4b4f-a688-1379d300b9cd',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.075621] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.075738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.075822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.075961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.076041] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c2c5148-c58a-4fc6-be42-8d4236e7fbb5',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.076855] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.076959] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.077132] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.077217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.077278] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49317fc3-59c5-4b8b-a14b-79b0c266a17a',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.077950] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de5d68d-6838-4955-ae71-d9dd48c0a125 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.078098] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.078159] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.078371] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.078371] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de5d68d-6838-4955-ae71-d9dd48c0a125',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.079069] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76720d0-5804-46fa-8a2f-21842f720546 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.079178] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.079240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.079843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.079843] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76720d0-5804-46fa-8a2f-21842f720546',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.080132] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.080253] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.080327] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.080483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.080564] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('790cacf0-2ff7-4926-9b9d-c3a421bdf3b0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.081351] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e669f6b-9b7b-497e-9670-1ddbd9860754 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.081473] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.081522] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.081664] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.081742] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e669f6b-9b7b-497e-9670-1ddbd9860754',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.082540] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d711ed5-98da-4810-9f03-9148ad645008 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.082669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.082727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.082856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.082915] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d711ed5-98da-4810-9f03-9148ad645008',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.083595] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd71eef3-fdb4-4293-8cf4-077891626874 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.083698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.083757] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.083910] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.083986] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd71eef3-fdb4-4293-8cf4-077891626874',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.084720] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35f81967-0f86-4790-a162-021bab0aad8d taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.084856] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.084943] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.085154] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.085279] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35f81967-0f86-4790-a162-021bab0aad8d',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.086190] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e923000-de4f-4614-8d9f-829896824884 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.086314] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.086382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.086606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.086718] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e923000-de4f-4614-8d9f-829896824884',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.087464] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73cf7e80-866c-4475-93d6-8e9e3254cf79 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.087567] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.087707] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.087807] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.087864] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73cf7e80-866c-4475-93d6-8e9e3254cf79',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.088538] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77ecb29c-d932-487b-b95d-59676b2a2f50 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.088679] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.088729] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.088855] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.088957] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77ecb29c-d932-487b-b95d-59676b2a2f50',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.089777] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7abf7f6-a856-4157-be54-ef99b007674f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.089896] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.089963] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.090175] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.090235] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7abf7f6-a856-4157-be54-ef99b007674f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.091034] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.091152] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.091214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.091377] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.091446] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdf28d13-db76-40d0-a00d-750f9a74b1d7',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.092121] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.092255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.092334] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.092490] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.092563] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fd17e7b-8910-4529-a801-b80ed3d29a0e',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.093263] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.093375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.093450] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.093622] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.093705] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa5dd68d-835d-4416-ac9f-cab1591b2b82',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.094608] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.094723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.094789] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.094948] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.095034] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.095715] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-285c5000-ac60-42b0-8441-f857f98438d0 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.095843] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.095961] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.096119] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.096193] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('285c5000-ac60-42b0-8441-f857f98438d0',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.129034] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.129190] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.129261] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.129465] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.132318] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.132417] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.133142] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.133255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.133913] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.134016] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.147694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.147801] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49317fc3-59c5-4b8b-a14b-79b0c266a17a is going to be deleted. [ 1736.148730] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.148938] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.166789] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.166952] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6688165-9289-4b4f-a688-1379d300b9cd is going to be deleted. [ 1736.167842] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.168095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.185899] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.186072] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de5d68d-6838-4955-ae71-d9dd48c0a125 is going to be deleted. [ 1736.187231] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.187460] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.213015] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.213244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.214331] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.214444] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c2c5148-c58a-4fc6-be42-8d4236e7fbb5 is going to be deleted. [ 1736.215297] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.215510] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.215596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.215711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49317fc3-59c5-4b8b-a14b-79b0c266a17a" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.216386] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.216501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.216569] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.216731] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.216808] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.216918] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6688165-9289-4b4f-a688-1379d300b9cd" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.231148] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.231332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.231332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.231506] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.231587] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.231694] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de5d68d-6838-4955-ae71-d9dd48c0a125" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.275881] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.276131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.276131] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.276281] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.276375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.276496] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c2c5148-c58a-4fc6-be42-8d4236e7fbb5" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.606862] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.607102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.607102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.607283] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.607386] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.607486] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.607549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.607700] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.607781] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.607866] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.607974] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.649500] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.649719] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.649794] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.650136] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.661251] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.661423] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.662801] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.662917] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.663807] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.663950] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.664636] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.664750] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.665502] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.665604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.666412] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.666552] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.667535] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.667630] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.668374] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.668468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.669234] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.669369] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.669994] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.670088] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.670684] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1736.671078] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.671183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.671745] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1736.672189] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.672301] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d711ed5-98da-4810-9f03-9148ad645008 is going to be deleted. [ 1736.673732] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.673824] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.673894] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.674102] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.675446] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.675543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.676116] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1736.676488] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.676580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.770488] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1736.771058] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.771191] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd71eef3-fdb4-4293-8cf4-077891626874 is going to be deleted. [ 1736.772246] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.772364] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.789026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.789162] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73cf7e80-866c-4475-93d6-8e9e3254cf79 is going to be deleted. [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.850244] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.850244] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa5dd68d-835d-4416-ac9f-cab1591b2b82 is going to be deleted. [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.850244] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.850244] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7abf7f6-a856-4157-be54-ef99b007674f is going to be deleted. [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.850244] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.877080] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.877080] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.884089] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.884312] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 790cacf0-2ff7-4926-9b9d-c3a421bdf3b0 is going to be deleted. [ 1736.885640] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.885958] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.889141] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.889304] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.904287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.904414] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e669f6b-9b7b-497e-9670-1ddbd9860754 is going to be deleted. [ 1736.905600] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.905839] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.926295] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.926499] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.954611] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.954755] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc is going to be deleted. [ 1736.955732] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.955995] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.008936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.009116] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e923000-de4f-4614-8d9f-829896824884 is going to be deleted. [ 1737.010031] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.010280] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.011647] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.011756] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.067778] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.067968] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.070188] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.070311] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fd17e7b-8910-4529-a801-b80ed3d29a0e is going to be deleted. [ 1737.071294] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.071571] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.116368] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1737.138133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.138295] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35f81967-0f86-4790-a162-021bab0aad8d is going to be deleted. [ 1737.139218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.139441] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.153018] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.153197] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.200952] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.201141] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.201782] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.201875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.203816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.203930] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77ecb29c-d932-487b-b95d-59676b2a2f50 is going to be deleted. [ 1737.204788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.205009] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.274696] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.274834] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76720d0-5804-46fa-8a2f-21842f720546 is going to be deleted. [ 1737.275760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.276026] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.280523] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.280659] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.335647] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.335821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.339455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.339588] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 285c5000-ac60-42b0-8441-f857f98438d0 is going to be deleted. [ 1737.340501] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.340816] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.383846] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.383973] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdf28d13-db76-40d0-a00d-750f9a74b1d7 is going to be deleted. [ 1737.385282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.385503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.385596] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.385720] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d711ed5-98da-4810-9f03-9148ad645008" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.385926] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.386108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.386195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.386333] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd71eef3-fdb4-4293-8cf4-077891626874" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.387553] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.387654] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.387723] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.387878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.387993] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.388125] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76720d0-5804-46fa-8a2f-21842f720546" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.388248] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.388396] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.388471] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.388580] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73cf7e80-866c-4475-93d6-8e9e3254cf79" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.388689] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.388829] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.388907] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.389030] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa5dd68d-835d-4416-ac9f-cab1591b2b82" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.389162] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.389301] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.389375] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.389484] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7abf7f6-a856-4157-be54-ef99b007674f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.389592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.389727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.389799] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.389906] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-790cacf0-2ff7-4926-9b9d-c3a421bdf3b0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.390043] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.390183] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.390255] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.390360] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e669f6b-9b7b-497e-9670-1ddbd9860754" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.390468] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.390604] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.390684] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.390819] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8686bb9-20e4-4e2b-9bfb-ed14cd45ffbc" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.390951] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.391109] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.391184] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.391287] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e923000-de4f-4614-8d9f-829896824884" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.391398] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.391532] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.391605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.391711] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fd17e7b-8910-4529-a801-b80ed3d29a0e" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.391845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.391985] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.392074] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.392174] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35f81967-0f86-4790-a162-021bab0aad8d" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.392282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.392418] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.392491] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.392592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77ecb29c-d932-487b-b95d-59676b2a2f50" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.484664] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.484822] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.484878] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.485117] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.485210] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.485335] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-285c5000-ac60-42b0-8441-f857f98438d0" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.524834] env[69756]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1737.525448] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.525583] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.525652] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.525867] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.525952] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.526095] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdf28d13-db76-40d0-a00d-750f9a74b1d7" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.619299] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa2899d8-52c4-48e7-80b1-761a59272093: rpc.has_security_group_logging(os_id): False [ 1737.656215] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.656388] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.656477] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.656801] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.678671] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.679061] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.679208] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.679260] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.679446] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.679526] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.679616] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1737.740401] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.740573] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.740606] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.740826] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.740976] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.752458] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1739.768063] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1739.768404] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1741.073357] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1741.073616] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1746.074826] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1746.074826] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1751.075715] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1751.075715] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1756.076168] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1756.076534] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1761.077986] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1761.078350] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1766.079438] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1766.079767] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1771.080809] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1771.081176] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1775.618936] env[69756]: INFO networking_nsxv3.common.synchronization [req-9770777d-199b-4e96-957e-730e6146d159 req-ea6a2164-8344-46ee-a507-cfaebc7ad98c tempest-ServerActionsTestOtherB-1068274652 tempest-ServerActionsTestOtherB-1068274652-project-member] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1775.619539] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1775.619845] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.620271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.620271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.620271] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.620399] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.620493] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.620546] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.620685] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.620774] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.620865] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1776.124604] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1776.124845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1776.124845] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1776.125071] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1776.125172] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1776.125381] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1776.125481] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1776.125543] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1776.125699] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1776.125772] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1776.125857] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1776.158650] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1776.158857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1776.158857] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1776.159092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1776.159217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1776.168833] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1778.179492] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1778.179901] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 deletion is rescheduled due to dependency. [ 1778.179901] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.620733] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1780.621110] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1783.646313] env[69756]: INFO networking_nsxv3.common.synchronization [req-2f7641f4-1275-4eae-aeb9-51f9e47ccfa4 req-f8497937-c62a-4f78-a292-bb98af7aee22 tempest-ServerActionsTestOtherB-1068274652 tempest-ServerActionsTestOtherB-1068274652-project-member] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1783.647106] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1783.647423] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1783.647603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1783.647603] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1783.647802] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1783.647952] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1783.648068] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1783.648130] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1783.648282] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1783.648353] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1783.648445] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1783.913636] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1783.913850] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1783.913982] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1783.914360] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1783.914633] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1783.914801] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1783.914926] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1783.915165] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1783.915322] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1783.915538] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1783.915658] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1783.915773] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1783.915885] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1783.916000] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1783.916128] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1783.916264] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1783.937188] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1783.937353] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1783.937494] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1783.937671] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1783.937994] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-2dddb28f-26e9-49ea-9021-95705806b75f taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1783.938175] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1783.938301] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1783.938678] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1783.938819] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dddb28f-26e9-49ea-9021-95705806b75f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1784.150486] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.150693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.150693] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.150884] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.150982] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.151189] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.151290] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.151351] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.151503] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.151578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.151664] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1784.177257] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.177410] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.177442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.177644] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.177796] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.187243] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1784.441013] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.441274] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.441413] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.441705] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.441862] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.442031] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Segment Port 2dddb28f-26e9-49ea-9021-95705806b75f not found, creating... [ 1784.442294] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.442551] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.442633] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.442808] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.442959] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.443276] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.443419] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.443539] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.443752] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.443892] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.444055] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 2dddb28f-26e9-49ea-9021-95705806b75f is going to be created. [ 1784.464469] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.464732] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.464835] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.465197] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.465493] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.465743] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.136589] env[69756]: INFO networking_nsxv3.common.synchronization [req-2f7641f4-1275-4eae-aeb9-51f9e47ccfa4 req-93ecda06-8133-45c5-b72e-ee62e7f45bfa service nova] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1785.136823] env[69756]: INFO networking_nsxv3.common.synchronization [req-2f7641f4-1275-4eae-aeb9-51f9e47ccfa4 req-93ecda06-8133-45c5-b72e-ee62e7f45bfa service nova] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1785.136943] env[69756]: INFO networking_nsxv3.common.synchronization [req-2f7641f4-1275-4eae-aeb9-51f9e47ccfa4 req-93ecda06-8133-45c5-b72e-ee62e7f45bfa service nova] Enqueued Resource ID: 2dddb28f-26e9-49ea-9021-95705806b75f with Priority: HIGHEST for action port [ 1785.137188] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1785.137315] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1785.137412] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dddb28f-26e9-49ea-9021-95705806b75f with Priority: HIGHEST for action port [ 1785.137949] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.138087] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.138167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.138347] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.138428] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1785.139268] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.139362] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.139578] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dddb28f-26e9-49ea-9021-95705806b75f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.139648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.139727] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.139888] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.139962] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dddb28f-26e9-49ea-9021-95705806b75f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1785.642056] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.642218] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.642368] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2dddb28f-26e9-49ea-9021-95705806b75f with status ACTIVE [ 1785.642544] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.642686] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.642738] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.642928] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.643050] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.643245] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.643374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.643400] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.643590] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.643672] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.643892] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.644075] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.644195] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.644437] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.644572] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.644708] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2dddb28f-26e9-49ea-9021-95705806b75f is going to be updated. [ 1785.666045] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.666045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.666045] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.666289] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.666444] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.666637] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.196469] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1786.196757] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 deletion is rescheduled due to dependency. [ 1786.196788] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.196978] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.197240] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.197433] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.197549] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.198094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.198094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.198094] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.198094] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1786.700637] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1787.203192] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1787.706577] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.706768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.706853] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.707070] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.707167] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.707270] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1787.734793] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.735108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.735108] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.735325] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.735752] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.745945] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1789.757751] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1789.758129] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.758163] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1789.758374] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1789.758564] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1789.758676] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1789.758773] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1789.758947] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1789.759044] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.759134] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.759228] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1790.138488] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1790.138488] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1790.261235] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1790.764301] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa2899d8-52c4-48e7-80b1-761a59272093: rpc.has_security_group_logging(os_id): False [ 1790.782342] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.782530] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.782576] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.782764] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.782854] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.783113] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.783214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.783278] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.783424] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.783500] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.783601] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1790.842992] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.843209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.843209] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.843430] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.843578] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.856838] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1792.874028] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1792.874426] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.139287] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1795.139644] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1800.140463] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1800.141022] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1805.142141] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1805.142543] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1810.143574] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1810.143959] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1815.145325] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1815.145325] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1820.146748] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1820.147114] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1825.148777] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1825.149185] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1830.149820] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1830.150139] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1835.151713] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1835.152112] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1840.153091] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1840.153531] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1845.153643] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1845.154026] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1850.155450] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1850.155450] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1855.156327] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1855.156327] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1855.968526] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1855.968726] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1855.968858] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1855.969171] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1855.969434] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1855.969596] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1855.969717] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1855.969971] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1855.970281] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1855.970503] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1855.970630] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] NeedRegenerationException {{(pid=69756) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1855.970747] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] no value, waiting for create lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1855.970861] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] value creation lock acquired {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1855.970978] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] No value present for key: 'zone-id' {{(pid=69756) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1855.971099] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Calling creation function for not-yet-present value {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1855.971238] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1856.001220] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1856.001431] env[69756]: DEBUG dogpile.cache.region [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69756) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1856.001548] env[69756]: DEBUG dogpile.lock [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Released creation lock {{(pid=69756) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1856.001737] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "network-523" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1856.002089] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock port-2dddb28f-26e9-49ea-9021-95705806b75f taken with stack trace [, , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1856.002296] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1856.002425] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1856.002713] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1856.002858] env[69756]: DEBUG networking_nsxv3.api.rpc [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dddb28f-26e9-49ea-9021-95705806b75f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1856.505685] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1856.507964] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1856.507964] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1856.507964] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1856.507964] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1856.507964] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1856.507964] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1856.507964] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1856.507964] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1856.508269] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1856.508359] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1856.508521] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1856.508645] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1856.508861] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1856.509011] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1856.509167] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Resource: SegmentPort with ID: 2dddb28f-26e9-49ea-9021-95705806b75f is going to be updated. [ 1856.530043] env[69756]: DEBUG networking_nsxv3.common.locking [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1856.530249] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1856.530353] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1856.531019] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1856.531238] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1856.531465] env[69756]: DEBUG oslo_concurrency.lockutils [None req-89a09932-570d-4cdd-bd92-856b41c808e7 None None] Releasing lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.186785] env[69756]: INFO networking_nsxv3.common.synchronization [req-1d94b1e0-d73e-484f-9a8c-3ab4effd7fb8 req-281d5b30-8833-4afd-ac48-e7f06b1b3e56 service nova] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1857.186999] env[69756]: INFO networking_nsxv3.common.synchronization [req-1d94b1e0-d73e-484f-9a8c-3ab4effd7fb8 req-281d5b30-8833-4afd-ac48-e7f06b1b3e56 service nova] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1857.187129] env[69756]: INFO networking_nsxv3.common.synchronization [req-1d94b1e0-d73e-484f-9a8c-3ab4effd7fb8 req-281d5b30-8833-4afd-ac48-e7f06b1b3e56 service nova] Enqueued Resource ID: 2dddb28f-26e9-49ea-9021-95705806b75f with Priority: HIGHEST for action port [ 1857.187363] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_rules [ 1857.187495] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1857.187601] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dddb28f-26e9-49ea-9021-95705806b75f with Priority: HIGHEST for action port [ 1857.188250] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.188405] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.188454] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.188648] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.188729] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1857.190818] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.190895] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.190974] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.191182] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.191319] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.191427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.191483] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.191809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.191809] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.191809] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1857.192694] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dddb28f-26e9-49ea-9021-95705806b75f taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.195133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.195133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.195133] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.195133] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dddb28f-26e9-49ea-9021-95705806b75f',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1857.691496] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.691875] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.696991] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2dddb28f-26e9-49ea-9021-95705806b75f with status ACTIVE [ 1857.697192] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.697326] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.697397] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.697610] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.697760] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.697944] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.698092] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.698191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.698453] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.698592] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.698809] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.698934] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.699057] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.699224] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.699332] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.699427] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2dddb28f-26e9-49ea-9021-95705806b75f is going to be updated. [ 1857.700542] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1857.723202] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.723382] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.723442] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.723605] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.723736] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.723890] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dddb28f-26e9-49ea-9021-95705806b75f" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1858.203032] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1858.705704] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1858.706217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1858.706217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1858.706217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1858.706217] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1858.706334] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1858.735113] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1858.735292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1858.735292] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1858.735489] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1858.735633] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1858.748239] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1860.759418] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1860.759749] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.759784] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.760060] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.760274] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.760390] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.760452] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.760620] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.760698] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.760783] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.760892] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1861.263561] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1861.765606] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa2899d8-52c4-48e7-80b1-761a59272093: rpc.has_security_group_logging(os_id): False [ 1861.784308] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.784508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.784508] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.784728] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.784821] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.785086] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.785214] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.785276] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.785427] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.785519] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.785611] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1861.850210] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.850381] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.850440] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.850624] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.850768] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.863234] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1862.189148] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1862.189148] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1863.884576] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1863.885191] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1867.190813] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1867.191198] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1872.192420] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1872.192754] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1873.472965] env[69756]: INFO networking_nsxv3.common.synchronization [req-8a2ab46b-1614-4948-be3d-a685b8c42ed4 req-68de3ae8-6f85-4e8f-8cfc-912817d40c8b tempest-ServerActionsTestOtherB-1068274652 tempest-ServerActionsTestOtherB-1068274652-project-member] Enqueued Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1873.473515] env[69756]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2899d8-52c4-48e7-80b1-761a59272093 with Priority: HIGHEST for action security_group_members [ 1873.473816] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa2899d8-52c4-48e7-80b1-761a59272093 taken with stack trace [, , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1873.473936] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1873.474008] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1873.474213] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1873.474365] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1873.474880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1873.474880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1873.474880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1873.474880] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1873.474880] env[69756]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa2899d8-52c4-48e7-80b1-761a59272093',) {} {{(pid=69756) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1873.977221] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1873.977455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1873.977455] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1873.977669] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1873.977766] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1873.977977] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1873.978115] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1873.978176] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1873.978337] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1873.978415] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1873.978504] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 is going to be updated. [ 1874.009445] env[69756]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69756) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1874.009625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1874.009625] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1874.009837] env[69756]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1874.009973] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1874.018291] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: IN_PROGRESS for 2s [ 1876.031544] env[69756]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa2899d8-52c4-48e7-80b1-761a59272093 in Status: SUCCESS [ 1876.031994] env[69756]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa2899d8-52c4-48e7-80b1-761a59272093 deletion is rescheduled due to dependency. [ 1876.031994] env[69756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa2899d8-52c4-48e7-80b1-761a59272093" {{(pid=69756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1878.475154] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1878.475534] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1883.476040] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1883.476294] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1888.477706] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1888.478138] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1893.478821] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1893.479392] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1898.480613] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1898.480613] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1903.481734] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1903.482133] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1908.482597] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1908.482867] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1913.483443] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1913.483771] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1917.498603] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1917.498990] env[69756]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fc4c0a4f-0d87-49eb-aa4e-3164f0e9b488 None None] NSXv3 Agent Agent loop - iteration:5 started [ 1918.484422] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1918.484605] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1923.485511] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1923.485844] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1928.486675] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1928.487054] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1933.487825] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1933.488130] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1938.488972] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1938.489332] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1943.490393] env[69756]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1943.490393] env[69756]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0